-- Logs begin at Fri 2022-08-26 11:33:48 UTC, end at Fri 2022-08-26 12:32:15 UTC. -- Aug 26 12:05:35.241686 dv-cinder-846303-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 12:05:35.250929 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 12:05:35 2022] *** Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: nodename: dv-cinder-846303-2-iscsi Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: machine: x86_64 Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: clock source: unix Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: pcre jit disabled Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: detected number of CPU cores: 4 Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: current working directory: / Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: detected binary path: /usr/bin/uwsgi-core Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: your processes number limit is 47680 Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: your memory page size is 4096 bytes Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: detected max file descriptor number: 2048 Aug 26 12:05:35.252938 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: lock engine: pthread robust mutexes Aug 26 12:05:35.253736 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: thunder lock: enabled Aug 26 12:05:35.253736 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 12:05:35.253736 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 12:05:35.292401 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: Python main interpreter initialized at 0x55b49bcd09c0 Aug 26 12:05:35.292401 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: python threads support enabled Aug 26 12:05:35.292401 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: your server socket listen backlog is limited to 100 connections Aug 26 12:05:35.292401 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: your mercy for graceful operations on workers is 90 seconds Aug 26 12:05:35.292734 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 12:05:35.292813 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: *** Operational MODE: preforking *** Aug 26 12:05:35.293057 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: *** uWSGI is running in multiple interpreter mode *** Aug 26 12:05:35.293057 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: spawned uWSGI master process (pid: 105721) Aug 26 12:05:35.293238 dv-cinder-846303-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 12:05:35.294436 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: spawned uWSGI worker 1 (pid: 105722, cores: 1) Aug 26 12:05:35.294436 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: spawned uWSGI worker 2 (pid: 105723, cores: 1) Aug 26 12:05:35.294436 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 12:05:35.958277 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 12:05:35.960032 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 12:05:37.036473 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:05:37.036473 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: from cryptography.utils import int_from_bytes Aug 26 12:05:37.037054 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:05:37.037054 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: from cryptography.utils import int_from_bytes Aug 26 12:05:37.041193 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:05:37.041193 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: from cryptography.utils import int_from_bytes Aug 26 12:05:37.041618 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:05:37.041618 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: from cryptography.utils import int_from_bytes Aug 26 12:05:39.535574 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 12:05:39.536139 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 12:05:39.536329 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 12:05:39.536686 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 12:05:39.536941 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 12:05:39.537325 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.537649 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.537969 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.538286 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.538612 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.538919 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.539256 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.539581 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.539908 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.540186 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 12:05:39.540586 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.540682 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 12:05:39.540752 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.540911 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 12:05:39.541016 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-2-iscsi {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.541283 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 12:05:39.541371 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.541542 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 12:05:39.541628 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.541889 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.541976 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.542208 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.542294 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.542513 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.542612 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.542834 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.542921 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.543140 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.543267 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.543534 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.543671 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.543862 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.544128 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.544234 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.544426 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.544606 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.544761 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.544849 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.545065 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.545156 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.545373 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.545491 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-2-iscsi {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.545677 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.545785 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.545994 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.546109 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.546303 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.546391 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.546634 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.546741 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.546927 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.547046 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.547274 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.547399 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-2-iscsi {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.547590 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.547706 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.548015 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.548100 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.548337 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.548439 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.548694 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.548800 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.549008 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.549102 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.549324 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.549410 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.549644 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.549822 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.549951 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.550039 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.550254 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.550347 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.550565 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.550664 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.550892 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.550987 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.551229 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.551338 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.551553 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.551642 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-2-iscsi {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.551855 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.551950 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.552163 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.552256 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.552470 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.552564 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.552787 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.552949 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.553090 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.553266 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.553393 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.553582 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.553681 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.553908 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.553995 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.554241 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.554327 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.554553 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.554646 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.554871 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.554960 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.555124 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.555327 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.555443 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.555831 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.555981 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.556119 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.556217 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.556298 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.556387 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.556599 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.556686 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.556913 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.557012 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.557226 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.557312 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.557532 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.557617 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.557837 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.557923 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.558089 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.558175 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.558401 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.558487 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.558727 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.558814 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559037 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559138 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559385 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559486 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559638 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559733 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559892 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.559990 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.560220 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.560379 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.560546 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.560642 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.560860 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.560946 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.561174 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.561267 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.561488 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.561583 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.561799 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.561885 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.562110 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.562204 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.562421 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.562550 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.562732 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.562819 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.563037 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.563131 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.563367 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.563457 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.563688 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.563786 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.564012 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.564107 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.564315 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.564408 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.564566 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.564653 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.564867 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.565025 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.565171 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.565279 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.565484 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.565592 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.565792 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.565935 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.566094 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.566259 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.566398 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.566576 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.566685 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.566899 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.567014 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.567243 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.567338 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.567559 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.567649 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.567872 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.567970 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.568179 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.568268 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.568482 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.568572 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.568788 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.568878 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.569091 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.569188 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.569358 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.569461 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.569665 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.569765 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.569975 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.570068 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.570290 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.570458 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.570595 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.570682 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.570897 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.570996 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.571221 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.571799 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.572043 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.572164 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.572355 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.572476 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.572666 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.572784 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.572977 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.573107 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.573287 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.573414 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.573598 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.573719 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.573905 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.574034 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.574216 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.574341 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.574525 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.574629 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.574835 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.574949 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.575157 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.575288 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.575503 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.575604 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.575869 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.575981 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.576120 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.576214 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.576431 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.576529 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.576741 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.576827 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.577062 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.577154 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.577365 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.577464 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.577669 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.577757 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.577969 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.578061 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.578271 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.578358 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.578568 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.578655 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.578887 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.578975 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.579226 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.579326 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.579531 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.579617 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.579837 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.579924 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.580143 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.580231 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.580453 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.580538 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.580776 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.580862 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.581088 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.581175 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.581398 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.581484 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.581706 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.581804 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.582014 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.582101 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.582322 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.582408 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.582631 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.582725 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.582939 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.583024 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.583291 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.583381 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.583601 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.583703 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.583912 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.583997 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.584224 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.584320 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.584530 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.584638 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.584843 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.584934 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.585157 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.585244 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.585482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:05:39.585575 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.585795 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.585881 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.586112 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.586202 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.586429 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.586516 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.586739 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.586824 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.587713 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.587814 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.588056 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.588144 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.588385 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.588491 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.588705 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.588793 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.589026 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.589121 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.589362 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.589456 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.589681 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.589767 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.589998 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.590085 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.590316 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.590405 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.590637 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.590732 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.590952 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.591039 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.591287 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.591444 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.591611 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.591707 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.591935 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.592021 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.592246 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.592332 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.592562 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.592725 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.592873 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.592967 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.593198 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.593285 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.593513 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.593610 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.593824 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.593910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.594137 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.594225 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.594450 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.594546 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.594760 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.594854 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.595092 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.595179 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.595432 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.595520 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.595753 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.595839 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.596068 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.596157 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.596380 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.596512 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.596696 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.596783 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.597009 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.597096 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.597320 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.597407 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.597630 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.597724 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.597934 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.598020 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.598237 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.598324 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.598538 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.598624 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.598845 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.598940 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.599147 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.599254 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.599489 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.599577 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.599815 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.599910 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.600118 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.600207 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.600446 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.600533 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.600749 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.600849 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.601057 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.601150 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.601366 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.601451 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.601673 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.601772 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.601990 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.602084 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.602299 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.602393 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.602676 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.602793 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.602955 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.603043 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.603293 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.603396 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.603603 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.603690 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.603907 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.603996 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.604216 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.604309 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.604518 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.604606 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.604823 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.604911 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.605133 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.605227 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.605438 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.605572 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.605745 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.605832 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.606092 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.606225 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.606411 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.606505 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.606728 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.606818 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.607036 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.607136 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.607374 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.607462 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.607692 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.607779 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.608003 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.608102 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.608314 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.608400 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.608637 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.608723 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.608945 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.609039 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.609261 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.609347 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.609564 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.609652 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.609872 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.609960 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.610175 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.610262 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.610477 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.610572 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.610777 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.610872 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.611082 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.611180 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.611407 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.611507 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.611709 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.611797 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.612015 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.612110 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.612316 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.612404 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.612616 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.612704 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.612935 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.613030 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.613240 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.613335 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.613541 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.613628 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.613841 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.613927 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.614142 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.614240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.614481 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.614576 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.614785 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.614872 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.615106 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.615223 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.615441 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.615529 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.615751 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.615845 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.616065 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.616164 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.616375 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.616467 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.616681 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.616766 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.616987 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.617073 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.617292 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.617384 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.617598 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.617683 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.617905 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.618005 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.618254 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.618343 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.618565 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.618659 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.618964 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.619051 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.619296 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.619387 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.619622 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.619709 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.619933 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.620029 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.620268 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.620365 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.620555 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.620649 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.620869 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.620965 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.621206 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.621294 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.621529 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.621691 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.621845 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.621940 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.622159 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.622245 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.622466 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.622565 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.622779 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.622866 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.623087 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.623174 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.623423 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.623520 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.623736 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.623822 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.624045 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.624140 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.624359 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.624457 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.624665 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.624752 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.624981 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.625070 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.625289 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.625377 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.625601 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.625693 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.625908 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.625994 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.626225 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.626313 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.626526 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.626616 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.626838 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.626924 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.627161 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.627303 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.627513 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.627606 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.627820 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.627913 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.628131 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.628219 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.628445 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.628530 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.628751 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.628836 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.629059 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.629147 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.629369 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.629454 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.629674 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.629773 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.629979 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.630066 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.630289 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.630376 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.630601 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.630695 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.630908 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.631003 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.631229 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.631334 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.631544 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.631638 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.631856 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.631943 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.632167 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.632259 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.632470 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.632569 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.632770 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.632857 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.633077 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.633174 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.633676 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.634272 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.634520 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.634700 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.634845 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.635029 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.635163 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.635378 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.635478 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.635694 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.635788 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.636008 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.636104 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.636327 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.636414 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.636650 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.636741 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.636967 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.637062 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.637272 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.637359 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.637582 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.637669 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.637906 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.637994 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.638208 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.638301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.638522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.638608 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.638833 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.638921 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.639136 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.639266 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.639473 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.639560 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.639779 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.639874 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.640084 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.640172 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.640403 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.640491 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.640716 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.640802 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.641021 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.641106 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.641330 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.641426 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.641637 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.641725 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.641944 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.642038 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.642250 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.642353 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.642563 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.642650 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.642868 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.642999 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.643176 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.643343 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.643506 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.643808 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.644117 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.644432 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.644996 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.645263 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.645367 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.645604 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.645691 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.645940 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.646034 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.646260 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.646348 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.646584 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.646670 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.646908 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.647041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.647249 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.647357 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.647565 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.647652 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.647874 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.647969 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.648184 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.648273 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.648488 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.648575 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.648792 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.648879 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.649103 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.649192 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.649990 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.650164 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.650295 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.650382 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.650646 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.650756 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.650970 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.651065 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.651300 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.651405 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.651608 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.651699 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.651911 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.652002 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.652216 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.652316 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.652534 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.652796 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.652887 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.653135 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.653224 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.653438 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.653529 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.653763 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.653853 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.654072 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.654170 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.654377 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.654475 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.654680 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.654784 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.654982 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.655073 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.655346 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.655451 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.655652 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.655743 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.655989 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.656080 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.656316 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.656416 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.656719 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.656827 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.656961 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.657064 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.657267 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.657360 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.657589 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.657680 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.657892 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.657995 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.658196 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.658287 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.658499 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.658596 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.658809 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.658895 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.659114 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.659227 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.659439 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.659526 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.659749 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.659855 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.660057 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.660145 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.660366 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.660453 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.660674 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.660824 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.660974 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.661061 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.661280 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.661367 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.661582 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.661683 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.661894 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.661999 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.662200 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.662287 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.662504 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.662636 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.662803 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.662898 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.663110 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.663197 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.663439 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.663541 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.663742 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.663852 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.664048 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.664168 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.664348 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.664497 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.664661 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.664800 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.664964 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.665700 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.665892 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.666029 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.666196 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.666414 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.666502 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.666736 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.666878 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.667055 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.667143 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.667391 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.667480 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.667710 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.667815 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.668012 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.668099 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.668317 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.668404 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.668624 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.668712 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.668928 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.669016 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.669234 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.669320 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.669543 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.669630 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.669863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.669958 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.670177 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.670270 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.670477 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.670571 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.670784 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.670907 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.671087 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.671173 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.671415 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.671505 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.671718 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.671806 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.672026 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.672121 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.672327 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.672416 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.672628 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.672716 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.672927 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.673027 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.673233 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.673322 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.673533 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.673621 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.673847 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.673942 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.674152 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.674239 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.674455 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.674543 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.674757 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.674853 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.675059 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.675146 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.675405 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.675495 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.675715 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.675809 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.676027 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.676114 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.676338 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.676425 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.676648 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.676736 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.676963 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.677050 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.677270 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.677357 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.677580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.677676 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.677892 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.677979 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.678195 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.678283 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.678502 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.678596 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.678809 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.678895 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.679115 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.679232 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.679441 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.679529 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.679743 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.679830 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.680049 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.680144 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.680357 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.680444 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.680730 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.681354 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.681552 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.681686 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.681976 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.682063 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.682306 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.682393 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.682614 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.682710 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.682923 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.683010 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.683254 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.683345 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.683564 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.683664 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.683871 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.683958 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.684180 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.684267 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.684491 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.684579 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.684801 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.684892 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.685110 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.685198 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.685419 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.685514 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.685728 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.685815 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.686030 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.686117 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.686336 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.686431 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.686641 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.686729 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.686943 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.687098 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.687287 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.687388 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.687595 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.687685 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.687898 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.687994 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.688204 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.688291 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.688506 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.688593 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.688814 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.688910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.689116 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.689204 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.689482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.689568 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.689814 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.689909 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.690129 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.690216 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.690429 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.690516 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.690736 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.690836 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.691047 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.691134 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.691433 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.691565 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.691692 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.691780 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.691993 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.692081 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.692312 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.692398 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.692630 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.692718 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.692945 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.693032 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.693260 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.693347 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.693572 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.693660 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.693873 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.693966 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.694181 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.694277 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.694490 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.694576 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.694789 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.694876 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.695090 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.695186 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.695417 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.695506 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.695735 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.695822 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.696037 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.696140 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.696538 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.696640 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.696722 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.696968 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.697106 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.697258 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.697424 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.697565 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.697743 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.697977 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.698066 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.698289 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.698379 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.698598 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.698685 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.698920 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.699025 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.699268 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.699361 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.699593 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.699681 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.699899 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.700022 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.700211 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.700341 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.700520 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.700658 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.700841 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.700977 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.701162 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.701288 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.701545 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.701647 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.701785 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.701885 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.702088 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.702219 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.702410 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.702530 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.702729 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.702830 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.703045 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.703142 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.703390 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.703480 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.703774 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.703873 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.704102 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.704197 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.704409 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.704527 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.704730 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.704845 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.705053 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.705142 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.705356 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.705566 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.705654 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.705882 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.705978 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.706200 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.706289 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.706530 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.706618 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.706849 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.706944 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.707153 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.707372 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.707488 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.707575 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.707797 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.707887 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.708103 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.708190 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.708406 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.708494 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.708709 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.708803 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.709028 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.709115 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.709330 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.709424 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.709650 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.709746 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.709961 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.710048 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.710281 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.710375 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.710601 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.710689 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.710905 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.711000 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.711247 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.711412 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.711560 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.711728 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.711897 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.712093 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.712188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.712424 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.712513 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.712759 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.712848 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.713074 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.713162 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.713387 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.713475 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.713705 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.713793 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.714019 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.714108 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.714332 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.714421 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.714661 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.714749 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.714972 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.715068 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.715315 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.715406 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.715633 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.715719 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.715950 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.716078 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.716255 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.716357 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.716557 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.716652 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.716867 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.716965 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.717172 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.717261 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.717476 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.717564 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.717778 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.717911 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.718087 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.718175 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.718388 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.718477 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.718689 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.718778 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.718991 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.719078 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.719334 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.719441 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.719641 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.719730 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.719959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.720047 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.720266 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.720354 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.720570 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.720665 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.720872 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.720959 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.721174 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.721275 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.721514 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.721609 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.721818 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.721923 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.722141 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.722237 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.722450 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.722540 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.722767 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.722855 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.723086 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.723182 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.723421 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.723513 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.723733 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.723832 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.724045 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.724145 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.724355 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.724443 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.724667 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.724754 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.724975 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.725140 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.725277 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.725370 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.725585 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.725672 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.725895 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.725990 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.726203 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.726293 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.726513 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.726717 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.726823 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.727046 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.727134 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.727384 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.728024 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.728241 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.728347 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.728556 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.728701 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.728870 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.728961 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.729182 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.729271 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.729492 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.729580 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.729800 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.729889 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.730109 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.730209 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.730418 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.730505 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.730745 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.730833 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.731063 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.731159 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.731413 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.731503 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.731746 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.731832 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.732057 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.732153 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.732370 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.732457 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.732682 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.732845 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.732995 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.733084 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.733310 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.733397 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.733624 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.733720 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.733946 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.734033 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.734257 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.734345 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.734570 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.734665 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.734882 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.735093 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.735188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.735451 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.735555 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.735772 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.735861 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.736095 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.736223 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.736402 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.736498 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.736708 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.736796 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.737018 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.737106 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.737327 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.737428 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.737641 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.737734 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.737959 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.738047 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.738275 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.738407 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.738589 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.738706 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.738904 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.739028 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.739545 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.739683 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.739683 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.739889 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.740003 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.740109 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.740291 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.740408 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.740612 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.740736 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.740932 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.741057 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.741295 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.741419 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.741615 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.741729 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.741927 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.742050 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.742231 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.742344 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.742533 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.742657 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.742839 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.742956 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.743785 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.743948 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.744101 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.744223 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.744367 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.744598 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.744726 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.744923 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.745038 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.745246 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.745370 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.745559 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.745681 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.745877 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.746090 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.746212 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.746436 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.746559 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.746751 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.746872 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.747071 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.747194 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.747420 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.747536 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.747735 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.747857 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.748478 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.748565 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.748645 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.748773 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.748863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.748943 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.749029 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.749229 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.749318 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.749535 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.749623 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.749837 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.749939 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.750138 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.750234 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.750444 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.750541 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.750749 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.750839 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.751049 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.751144 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.751388 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.751479 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.751688 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.751779 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.752010 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.752098 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.752312 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.752399 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.752614 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.752702 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.752914 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.753011 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.753221 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.753309 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.753521 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.753618 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.753826 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.753914 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.754128 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.754390 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.754479 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.754722 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.754815 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.755022 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.755110 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.755347 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.755449 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.755650 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.755738 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.755957 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.756045 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.756255 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.756344 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.756559 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.756654 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.756914 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.757008 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.757231 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.757320 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.757532 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.757620 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.757830 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.757928 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.758142 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.758515 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.758700 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.758828 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.759059 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.759319 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.759476 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.759639 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.759790 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.759950 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.760135 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.760269 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.760447 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.760579 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.760912 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.760999 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.761226 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.761323 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.761538 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.761626 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.761849 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.761944 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.762169 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.762258 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.762479 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.762566 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.762788 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.762886 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.763099 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.763247 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.763434 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.763533 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.763750 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.763844 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.764057 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.764145 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.764364 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.764452 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.764670 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.764764 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.764975 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.765062 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.765280 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.765367 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.765586 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.765685 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.765894 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.765988 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.766201 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.766296 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.766507 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.766603 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.766814 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.766902 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.767119 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.767225 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.767457 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.767555 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.767763 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.767851 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.768072 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.768167 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.768411 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.768502 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.768726 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.768813 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.769040 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.769127 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.769351 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.769597 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.769685 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.769944 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.770032 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.770251 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.770346 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.770557 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.770646 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.770864 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.770958 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.771177 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.771336 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.771531 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.771620 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.771843 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.771939 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.772147 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.772235 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.772499 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.772586 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.772821 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.772919 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.773141 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.773229 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.773463 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.773550 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.773768 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.773862 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.774084 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.774172 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.774425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.774577 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.774782 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.775105 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.775537 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.775537 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.776610 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.776725 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.776813 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.776913 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.776998 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777078 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777156 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777234 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777312 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777399 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777480 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777557 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777635 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777712 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777798 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.777879 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.778041 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.778132 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.778368 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.778458 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.778693 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.778806 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.778998 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.779157 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.779329 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.779420 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.779632 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.779723 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.779934 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.780029 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.780235 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.780333 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.780536 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.780624 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.780841 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.780929 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.781141 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.781243 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.781442 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.781530 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.781742 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.781916 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.782040 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.782237 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.782326 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.782564 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.782661 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.782894 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.782982 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.783224 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.783315 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.783529 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.783617 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.783833 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.783937 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.784134 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.784222 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.784432 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.784520 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.784761 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.784858 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.785092 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.785180 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.785405 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.785493 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.785772 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.785881 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.786032 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.786120 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.786350 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.786438 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.786657 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.786747 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.786964 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.787050 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.787304 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.787395 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.787617 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.787705 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.787924 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.788020 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.788238 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.788325 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.788550 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.788639 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.788863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.788963 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.789165 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.789253 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.789471 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.789560 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.789776 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.789864 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.790620 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.790727 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.790941 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.791140 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.791261 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.791496 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.791627 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.791806 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.791897 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.792131 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.792219 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.792448 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.792538 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.792755 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.792845 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.793072 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.793167 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.793381 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.793477 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.793689 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.793778 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.793997 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.794085 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.794305 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.794401 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.794613 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.794700 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.794922 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.795009 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.795251 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.795355 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.795567 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.795656 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.795879 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.795968 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.796189 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.796289 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.796504 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.796594 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.796819 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.796907 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.797143 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.797232 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.797465 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.797552 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.797772 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.797860 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.798085 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.798172 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.798406 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.798492 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.798735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.798825 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.799051 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.799149 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.799387 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.799476 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.799706 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.799804 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.800024 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.800112 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.800333 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.800420 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.800640 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.800741 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.800882 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105723) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 12:05:39.800972 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.801285 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.801618 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.801942 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.802269 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.802590 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.802907 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.803261 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.803582 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.803899 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.804218 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.804535 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.804852 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.805175 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.805491 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.806477 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.806912 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.807324 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.807698 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.808091 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.808454 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.808797 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.809135 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.809491 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.809811 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.810162 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.810499 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.810820 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.811141 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.811479 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:05:39.811727 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 12:05:39.955706 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO dbcounter [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Registered counter for database nova_api Aug 26 12:05:39.965905 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO dbcounter [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Registered counter for database nova_api Aug 26 12:05:39.976735 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_db.sqlalchemy.engines [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:39.984063 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writer thread running {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:39.986095 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_db.sqlalchemy.engines [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:39.992659 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writer thread running {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:40.040666 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.context [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e12ffa3-4320-4138-9a47-c092f122fe94(cell1) {{(pid=105723) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 12:05:40.044428 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:05:40.044892 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:05:40.046426 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:05:40.047130 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:05:40.047594 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:05:40.049095 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.context [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e12ffa3-4320-4138-9a47-c092f122fe94(cell1) {{(pid=105722) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 12:05:40.049531 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:05:40.051515 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO dbcounter [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Registered counter for database nova_cell0 Aug 26 12:05:40.052913 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_concurrency.lockutils [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:05:40.053383 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_concurrency.lockutils [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:05:40.054949 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_concurrency.lockutils [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:05:40.055502 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO dbcounter [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Registered counter for database nova_cell1 Aug 26 12:05:40.056253 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_concurrency.lockutils [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:05:40.056771 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_concurrency.lockutils [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:05:40.058717 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_concurrency.lockutils [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:05:40.060758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO dbcounter [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Registered counter for database nova_cell0 Aug 26 12:05:40.063061 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_db.sqlalchemy.engines [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:40.064752 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_db.sqlalchemy.engines [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:40.066514 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO dbcounter [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Registered counter for database nova_cell1 Aug 26 12:05:40.070107 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writer thread running {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:40.075925 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writer thread running {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:40.076488 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_db.sqlalchemy.engines [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:40.077790 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_db.sqlalchemy.engines [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:40.083764 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writer thread running {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:40.086435 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writer thread running {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:40.215457 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO dbcounter [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Registered counter for database nova_cell0 Aug 26 12:05:40.224120 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_db.sqlalchemy.engines [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105723) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:40.228428 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writer thread running {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:40.230169 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO dbcounter [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Registered counter for database nova_cell0 Aug 26 12:05:40.238842 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG oslo_db.sqlalchemy.engines [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:05:40.243667 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writer thread running {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:05:40.564426 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: WARNING keystonemiddleware.auth_token [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:05:40.571696 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: WARNING keystonemiddleware.auth_token [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:05:40.577898 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: WARNING keystonemiddleware.auth_token [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:05:40.585139 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: WARNING keystonemiddleware.auth_token [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:05:40.910402 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: WARNING keystonemiddleware.auth_token [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:05:40.917183 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: WARNING keystonemiddleware.auth_token [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:05:40.922355 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b49bcd09c0 pid: 105723 (default app) Aug 26 12:05:40.924412 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:05:40.925580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001690 Aug 26 12:05:40.925979 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Fri Aug 26 12:05:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:05:40.932131 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: WARNING keystonemiddleware.auth_token [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:05:40.938094 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: WARNING keystonemiddleware.auth_token [None req-96793bc3-5859-452c-b912-c01b78f7fbfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:05:40.943381 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b49bcd09c0 pid: 105722 (default app) Aug 26 12:06:59.161117 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:06:59.162501 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001811 Aug 26 12:06:59.163416 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:06:59.175098 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writing DB stats nova_api:SELECT=3 {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:06:59.176298 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writing DB stats nova_cell1:SELECT=3 {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:06:59.177406 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writing DB stats nova_cell0:SELECT=3 {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:06:59.178513 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:00.118631 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-af0fe301-f2b1-45d2-a7ab-a4c4a28469c9 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:00.153309 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-af0fe301-f2b1-45d2-a7ab-a4c4a28469c9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.983364 Aug 26 12:07:00.155250 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Fri Aug 26 12:06:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:02.551055 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:02.552799 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-dad9e9b7-cf15-4115-8eda-be0112589b2b None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 26 12:07:02.555250 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:03.002015 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-05286efb-402d-43eb-827b-6cd2d678f922 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "ram": 256, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1"}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:03.060866 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-05286efb-402d-43eb-827b-6cd2d678f922 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.501382 Aug 26 12:07:03.061741 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:07:03.075166 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_api:SELECT=3 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:03.076336 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_cell0:SELECT=3 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:03.077124 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_cell1:SELECT=3 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:03.078011 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:03.297513 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-aeded7bc-03d1-4ab6-a2e7-5f4822915175 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:03.359570 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-aeded7bc-03d1-4ab6-a2e7-5f4822915175 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289512 Aug 26 12:07:03.360162 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Fri Aug 26 12:07:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:05.724601 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-05286efb-402d-43eb-827b-6cd2d678f922 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:05.725633 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-05286efb-402d-43eb-827b-6cd2d678f922 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 26 12:07:05.726392 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:06.401814 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-a5952e85-6a4a-41a9-997a-4da056762211 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:06.440994 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-a5952e85-6a4a-41a9-997a-4da056762211 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.708597 Aug 26 12:07:06.443295 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:07:06.454466 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-fa7dad5b-83a5-4e57-9dee-ae9514be6000 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:06.496138 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-fa7dad5b-83a5-4e57-9dee-ae9514be6000 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045272 Aug 26 12:07:06.496728 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Fri Aug 26 12:07:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:08.842246 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-a5952e85-6a4a-41a9-997a-4da056762211 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:08.843316 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-a5952e85-6a4a-41a9-997a-4da056762211 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 Aug 26 12:07:08.843714 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:09.254389 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-029786e3-42ea-4281-b0c3-bc6fddfb2e77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "disk": 10, "swap": 0, "name": "ds1G"}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:09.273660 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-029786e3-42ea-4281-b0c3-bc6fddfb2e77 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423039 Aug 26 12:07:09.274212 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:07:09.287002 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-e419fade-63a8-4a55-87e6-b22ee2efcce7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:09.310473 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-e419fade-63a8-4a55-87e6-b22ee2efcce7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027831 Aug 26 12:07:09.311047 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Fri Aug 26 12:07:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:07:11.697761 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-029786e3-42ea-4281-b0c3-bc6fddfb2e77 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:11.698771 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-029786e3-42ea-4281-b0c3-bc6fddfb2e77 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 26 12:07:11.699168 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:12.186540 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-ec257d54-7bbd-4ff9-bb13-4bde8a29cda5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:12.206845 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-ec257d54-7bbd-4ff9-bb13-4bde8a29cda5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.501487 Aug 26 12:07:12.207450 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:07:12.219528 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-801e9faf-7a29-4c4b-bd94-18c3d5dcb61c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:12.244381 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-801e9faf-7a29-4c4b-bd94-18c3d5dcb61c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028582 Aug 26 12:07:12.244960 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Fri Aug 26 12:07:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:07:14.591318 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-ec257d54-7bbd-4ff9-bb13-4bde8a29cda5 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:14.592316 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-ec257d54-7bbd-4ff9-bb13-4bde8a29cda5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 26 12:07:14.592894 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:15.025401 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-5e900f22-102c-492a-b726-003876de7385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:15.048775 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-5e900f22-102c-492a-b726-003876de7385 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449144 Aug 26 12:07:15.049966 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:07:15.061879 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-d76d1c2f-2628-4589-822c-cdc0ccd0a3c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:15.087804 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-d76d1c2f-2628-4589-822c-cdc0ccd0a3c9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029413 Aug 26 12:07:15.088565 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Fri Aug 26 12:07:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:17.748337 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-5e900f22-102c-492a-b726-003876de7385 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:17.749395 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-5e900f22-102c-492a-b726-003876de7385 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 26 12:07:17.750104 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:18.176398 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-1897638d-7ffd-44cd-aad6-12e188c032bb admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:18.205221 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-1897638d-7ffd-44cd-aad6-12e188c032bb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448242 Aug 26 12:07:18.205790 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Fri Aug 26 12:07:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:07:20.599007 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-5e900f22-102c-492a-b726-003876de7385 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:20.600029 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-5e900f22-102c-492a-b726-003876de7385 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 26 12:07:20.600462 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:21.013926 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-60a9414a-468c-4d7c-9e56-b033c71cc23d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:21.034269 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-60a9414a-468c-4d7c-9e56-b033c71cc23d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.427549 Aug 26 12:07:21.034981 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:07:21.047135 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-a43f8a80-0acb-414e-b67f-39c8c06bb3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:21.071125 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-a43f8a80-0acb-414e-b67f-39c8c06bb3d4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027694 Aug 26 12:07:21.071727 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Fri Aug 26 12:07:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:23.429851 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-60a9414a-468c-4d7c-9e56-b033c71cc23d admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:23.430863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-60a9414a-468c-4d7c-9e56-b033c71cc23d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 26 12:07:23.431297 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:07:23.830326 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d8e6756b-5442-4fd6-8771-a59b7a7d539b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:23.850631 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d8e6756b-5442-4fd6-8771-a59b7a7d539b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413381 Aug 26 12:07:23.851183 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:07:23.863048 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-09bc1fdb-970b-4ecc-be9e-5e3b8281e3ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:23.891316 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-09bc1fdb-970b-4ecc-be9e-5e3b8281e3ed admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031917 Aug 26 12:07:23.891899 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Fri Aug 26 12:07:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:26.200038 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d8e6756b-5442-4fd6-8771-a59b7a7d539b admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:26.201061 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d8e6756b-5442-4fd6-8771-a59b7a7d539b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 26 12:07:26.201475 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:26.621532 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-b3f25ae1-671f-446a-aebf-0484152216fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "3", "name": "m1.medium"}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:26.642031 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-b3f25ae1-671f-446a-aebf-0484152216fa admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.433804 Aug 26 12:07:26.642602 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:26 2022] POST /compute/v2.1/flavors => generated 406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:07:26.654913 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-b3fc6e08-ff67-4e93-898c-841b57af1c8f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:26.680297 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-b3fc6e08-ff67-4e93-898c-841b57af1c8f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028936 Aug 26 12:07:26.680865 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Fri Aug 26 12:07:26 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:29.074379 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-b3f25ae1-671f-446a-aebf-0484152216fa admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:29.076264 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-b3f25ae1-671f-446a-aebf-0484152216fa admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002313 Aug 26 12:07:29.076754 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:29.555951 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-6b18afea-2c31-446f-b0ef-80b96af31345 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:29.562529 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:29.577435 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-6b18afea-2c31-446f-b0ef-80b96af31345 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.493991 Aug 26 12:07:29.578002 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:07:29.590836 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-4fc94cc8-eaf8-439f-9800-91292cb5ee88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:29.614274 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-4fc94cc8-eaf8-439f-9800-91292cb5ee88 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027112 Aug 26 12:07:29.619621 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Fri Aug 26 12:07:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:07:32.008305 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-6b18afea-2c31-446f-b0ef-80b96af31345 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:32.009332 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-6b18afea-2c31-446f-b0ef-80b96af31345 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 26 12:07:32.010058 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:32.450992 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-336a8ab2-16a2-45f0-b72c-afe92ff68a2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:32.471102 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-336a8ab2-16a2-45f0-b72c-afe92ff68a2f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454856 Aug 26 12:07:32.472198 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Fri Aug 26 12:07:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:07:32.484022 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-e422dbca-bba8-44ab-91ca-58a1d1822632 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:32.511507 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-e422dbca-bba8-44ab-91ca-58a1d1822632 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030998 Aug 26 12:07:32.512088 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Fri Aug 26 12:07:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:07:52.369933 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-336a8ab2-16a2-45f0-b72c-afe92ff68a2f admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:52.370943 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-336a8ab2-16a2-45f0-b72c-afe92ff68a2f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 26 12:07:52.371374 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:07:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:52.382599 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:52.764451 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-a22d13c2-d8b7-4945-a243-f580a11b7036 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:52.782279 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-a22d13c2-d8b7-4945-a243-f580a11b7036 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404317 Aug 26 12:07:52.782845 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Fri Aug 26 12:07:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:07:53.848199 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-336a8ab2-16a2-45f0-b72c-afe92ff68a2f admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:53.849241 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-336a8ab2-16a2-45f0-b72c-afe92ff68a2f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 26 12:07:53.849642 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:07:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:54.365067 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-b74f5c1e-8808-4afe-853d-69fc790eca2d admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:54.370617 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.wsgi [None req-b74f5c1e-8808-4afe-853d-69fc790eca2d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-b74f5c1e-8808-4afe-853d-69fc790eca2d admin admin] Request method failure captured: Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Accept: application/json Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Accept-Encoding: gzip, deflate Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Connection: keep-alive Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Content-Length: 0 Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Host: 10.222.0.61 Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Openstack-Api-Version: compute 2.90 Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Openstack-System-Scope: None Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: User-Agent: python-novaclient Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Auth-Token: gAAAAABjCLeZElHmKkx775MrSWECf2vvYcN4LmtS4_cKsVurpjDl8J0lMj22t_WhiU-dAfT-2pZQWCJRaCtPJLKBd2Kh0exwc4uOoCd7G7FbutlFGx8UqGKPPDmkUXXCfonLVGDQ8emokDJd6KBMPh8vWf5vJdXgg3KBozoCMBks-3dEVAvRqPY Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Domain-Id: None Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Domain-Name: None Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Identity-Status: Confirmed Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Is-Admin-Project: True Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Domain-Id: default Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Domain-Name: Default Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Name: admin Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Role: admin,member,reader Aug 26 12:07:54.373850 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Roles: admin,member,reader Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b98963fff98a48a1b4cae11131b453da", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant: admin Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant-Name: admin Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User: admin Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Domain-Id: default Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Domain-Name: Default Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Id: d101ea12e0cd40e0b25022bf649ac734 Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Name: admin Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: method: > Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: exception: Flavor 42 could not be found. Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: action_args: {'id': '42'} Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:07:54.375522 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:54.377240 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.378910 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-b74f5c1e-8808-4afe-853d-69fc790eca2d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:07:54.380200 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-b74f5c1e-8808-4afe-853d-69fc790eca2d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.387700 Aug 26 12:07:54.380200 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Aug 26 12:07:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 12:07:54.385980 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-602fb13f-8a12-4d49-b386-e45d0bb42a8f admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:54.390189 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:07:54.410534 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-602fb13f-8a12-4d49-b386-e45d0bb42a8f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028077 Aug 26 12:07:54.411096 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Aug 26 12:07:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:07:54.420619 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-581bf37a-fca4-4ba3-bd0a-5c3428436aa6 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:54.444976 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-581bf37a-fca4-4ba3-bd0a-5c3428436aa6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027878 Aug 26 12:07:54.445506 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Aug 26 12:07:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:07:54.454650 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-1048e509-0c4a-40f6-bd5d-821dc7940cc3 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:54.461129 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.wsgi [None req-1048e509-0c4a-40f6-bd5d-821dc7940cc3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-1048e509-0c4a-40f6-bd5d-821dc7940cc3 admin admin] Request method failure captured: Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Accept: application/json Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Accept-Encoding: gzip, deflate Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Connection: keep-alive Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Content-Length: 0 Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Host: 10.222.0.61 Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Openstack-Api-Version: compute 2.90 Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Openstack-System-Scope: None Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: User-Agent: python-novaclient Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Auth-Token: gAAAAABjCLeZElHmKkx775MrSWECf2vvYcN4LmtS4_cKsVurpjDl8J0lMj22t_WhiU-dAfT-2pZQWCJRaCtPJLKBd2Kh0exwc4uOoCd7G7FbutlFGx8UqGKPPDmkUXXCfonLVGDQ8emokDJd6KBMPh8vWf5vJdXgg3KBozoCMBks-3dEVAvRqPY Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Domain-Id: None Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Domain-Name: None Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Identity-Status: Confirmed Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Is-Admin-Project: True Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Domain-Id: default Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Domain-Name: Default Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Name: admin Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Role: admin,member,reader Aug 26 12:07:54.464389 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Roles: admin,member,reader Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b98963fff98a48a1b4cae11131b453da", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant: admin Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant-Name: admin Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User: admin Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Domain-Id: default Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Domain-Name: Default Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Id: d101ea12e0cd40e0b25022bf649ac734 Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Name: admin Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: method: > Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: exception: Flavor 42 could not be found. Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: action_args: {'id': '42'} Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:07:54.465890 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:54.466863 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:54.467959 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-1048e509-0c4a-40f6-bd5d-821dc7940cc3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:07:54.468995 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-1048e509-0c4a-40f6-bd5d-821dc7940cc3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014716 Aug 26 12:07:54.468995 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Aug 26 12:07:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 12:07:55.426812 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-581bf37a-fca4-4ba3-bd0a-5c3428436aa6 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:55.427852 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-581bf37a-fca4-4ba3-bd0a-5c3428436aa6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 26 12:07:55.428244 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:07:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:55.944832 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-9adfbdb7-d754-4514-b28f-8d8d9070129d admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:55.950520 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.wsgi [None req-9adfbdb7-d754-4514-b28f-8d8d9070129d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-9adfbdb7-d754-4514-b28f-8d8d9070129d admin admin] Request method failure captured: Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Accept: application/json Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Accept-Encoding: gzip, deflate Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Connection: keep-alive Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Content-Length: 0 Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Host: 10.222.0.61 Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Openstack-Api-Version: compute 2.90 Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Openstack-System-Scope: None Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: User-Agent: python-novaclient Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Auth-Token: gAAAAABjCLeb40MCElqyeEiZ5bfogxpIPgBKQMRuQvd3J944xSBOkhml4QajnQYn2NdxQwDlORTbD4n8OWfd7ekLbBINtoTLle_3uSGFH_lzLiy3ZC2ec7QE6vKEXtX3BGrkkfXVkDH-82iiebr7x2UOwc1N0b11Yf_3k1yEW09PhuN7Oo6jiiI Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Domain-Id: None Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Domain-Name: None Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Identity-Status: Confirmed Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Is-Admin-Project: True Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Domain-Id: default Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Domain-Name: Default Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Name: admin Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Role: admin,member,reader Aug 26 12:07:55.952041 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Roles: admin,member,reader Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b98963fff98a48a1b4cae11131b453da", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant: admin Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant-Name: admin Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User: admin Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Domain-Id: default Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Domain-Name: Default Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Id: d101ea12e0cd40e0b25022bf649ac734 Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Name: admin Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: method: > Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: exception: Flavor 84 could not be found. Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: action_args: {'id': '84'} Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:07:55.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:55.955188 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:55.956643 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-9adfbdb7-d754-4514-b28f-8d8d9070129d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:07:55.957871 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-9adfbdb7-d754-4514-b28f-8d8d9070129d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.390050 Aug 26 12:07:55.957871 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Aug 26 12:07:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 12:07:55.963836 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-ee3a9347-88a3-4313-9c7b-8bfcc2b59202 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:55.979500 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-ee3a9347-88a3-4313-9c7b-8bfcc2b59202 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019210 Aug 26 12:07:55.980034 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Aug 26 12:07:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:07:55.989259 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-b7ade83d-bcb5-4a80-afbf-1f39737b6b80 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:56.004654 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-b7ade83d-bcb5-4a80-afbf-1f39737b6b80 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018928 Aug 26 12:07:56.005166 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Aug 26 12:07:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:07:56.014279 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-14ed5d74-bdf8-4e02-8725-10cfac72c120 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:56.020247 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.wsgi [None req-14ed5d74-bdf8-4e02-8725-10cfac72c120 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-14ed5d74-bdf8-4e02-8725-10cfac72c120 admin admin] Request method failure captured: Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Accept: application/json Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Accept-Encoding: gzip, deflate Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Connection: keep-alive Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Content-Length: 0 Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Host: 10.222.0.61 Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Openstack-Api-Version: compute 2.90 Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Openstack-System-Scope: None Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: User-Agent: python-novaclient Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Auth-Token: gAAAAABjCLeb40MCElqyeEiZ5bfogxpIPgBKQMRuQvd3J944xSBOkhml4QajnQYn2NdxQwDlORTbD4n8OWfd7ekLbBINtoTLle_3uSGFH_lzLiy3ZC2ec7QE6vKEXtX3BGrkkfXVkDH-82iiebr7x2UOwc1N0b11Yf_3k1yEW09PhuN7Oo6jiiI Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Domain-Id: None Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Domain-Name: None Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Identity-Status: Confirmed Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Is-Admin-Project: True Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Domain-Id: default Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Domain-Name: Default Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Name: admin Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Role: admin,member,reader Aug 26 12:07:56.021735 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Roles: admin,member,reader Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b98963fff98a48a1b4cae11131b453da", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant: admin Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant-Name: admin Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User: admin Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Domain-Id: default Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Domain-Name: Default Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Id: d101ea12e0cd40e0b25022bf649ac734 Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Name: admin Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: method: > Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: exception: Flavor 84 could not be found. Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: action_args: {'id': '84'} Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:07:56.023436 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:56.024301 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:56.025482 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-14ed5d74-bdf8-4e02-8725-10cfac72c120 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:07:56.026927 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-14ed5d74-bdf8-4e02-8725-10cfac72c120 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012269 Aug 26 12:07:56.026927 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Fri Aug 26 12:07:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 12:07:56.986733 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-b7ade83d-bcb5-4a80-afbf-1f39737b6b80 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:56.987909 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-b7ade83d-bcb5-4a80-afbf-1f39737b6b80 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 26 12:07:56.988310 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:07:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:57.503548 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-c71c170d-a88e-4dcb-b381-863523e6e95b admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:57.509271 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.wsgi [None req-c71c170d-a88e-4dcb-b381-863523e6e95b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-c71c170d-a88e-4dcb-b381-863523e6e95b admin admin] Request method failure captured: Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Accept: application/json Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Accept-Encoding: gzip, deflate Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Connection: keep-alive Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Content-Length: 0 Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Host: 10.222.0.61 Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Openstack-Api-Version: compute 2.90 Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Openstack-System-Scope: None Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: User-Agent: python-novaclient Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Auth-Token: gAAAAABjCLecXiPmo-fwjXrpZSJ0VkE1y-c-p4NZnLYrlouwKgxT5ASuTXfqQDCWaS667aMcvYcEm2s5XEtVnfzMdUG8DM08NfZUqU3bS9azGZWe-OGBGdefg0q1reiF_NTpwsF4hAkgieQ48T7NKTriyVlhrxtqxUDJw16FQDPcnGNsd0JkqOc Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Domain-Id: None Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Domain-Name: None Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Identity-Status: Confirmed Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Is-Admin-Project: True Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Domain-Id: default Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Domain-Name: Default Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Project-Name: admin Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Role: admin,member,reader Aug 26 12:07:57.510770 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Roles: admin,member,reader Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b98963fff98a48a1b4cae11131b453da", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant: admin Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-Tenant-Name: admin Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User: admin Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Domain-Id: default Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Domain-Name: Default Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Id: d101ea12e0cd40e0b25022bf649ac734 Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: X-User-Name: admin Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: method: > Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: exception: Flavor 451 could not be found. Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: action_args: {'id': '451'} Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:07:57.512342 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:57.513425 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.514758 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-c71c170d-a88e-4dcb-b381-863523e6e95b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105722) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:07:57.516022 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-c71c170d-a88e-4dcb-b381-863523e6e95b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.387289 Aug 26 12:07:57.516022 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Aug 26 12:07:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 26 12:07:57.521785 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-44d9ec2b-820c-4467-9655-7250ee662a51 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:57.536889 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-44d9ec2b-820c-4467-9655-7250ee662a51 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018753 Aug 26 12:07:57.537425 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Aug 26 12:07:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:07:57.546573 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:57.561914 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018818 Aug 26 12:07:57.562438 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Fri Aug 26 12:07:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:07:57.571463 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-726e590a-bc74-4e40-a3ae-6660d73002e3 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:57.576759 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.wsgi [None req-726e590a-bc74-4e40-a3ae-6660d73002e3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-726e590a-bc74-4e40-a3ae-6660d73002e3 admin admin] Request method failure captured: Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Accept: application/json Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Accept-Encoding: gzip, deflate Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Connection: keep-alive Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Content-Length: 0 Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Host: 10.222.0.61 Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Openstack-Api-Version: compute 2.90 Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Openstack-System-Scope: None Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: User-Agent: python-novaclient Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Auth-Token: gAAAAABjCLecXiPmo-fwjXrpZSJ0VkE1y-c-p4NZnLYrlouwKgxT5ASuTXfqQDCWaS667aMcvYcEm2s5XEtVnfzMdUG8DM08NfZUqU3bS9azGZWe-OGBGdefg0q1reiF_NTpwsF4hAkgieQ48T7NKTriyVlhrxtqxUDJw16FQDPcnGNsd0JkqOc Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Domain-Id: None Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Domain-Name: None Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Identity-Status: Confirmed Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Is-Admin-Project: True Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Openstack-Nova-Api-Version: 2.90 Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Domain-Id: default Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Domain-Name: Default Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Project-Name: admin Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Role: admin,member,reader Aug 26 12:07:57.578227 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Roles: admin,member,reader Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b98963fff98a48a1b4cae11131b453da", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b98963fff98a48a1b4cae11131b453da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant: admin Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant-Id: b98963fff98a48a1b4cae11131b453da Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-Tenant-Name: admin Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User: admin Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Domain-Id: default Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Domain-Name: Default Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Id: d101ea12e0cd40e0b25022bf649ac734 Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: X-User-Name: admin Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: method: > Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: exception: Flavor 451 could not be found. Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: action_args: {'id': '451'} Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:07:57.579771 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:57.580721 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: ERROR nova.api.openstack.wsgi Aug 26 12:07:57.582150 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-726e590a-bc74-4e40-a3ae-6660d73002e3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105723) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:07:57.583421 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-726e590a-bc74-4e40-a3ae-6660d73002e3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011546 Aug 26 12:07:57.583421 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Aug 26 12:07:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 26 12:07:58.536576 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:07:58.537578 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 26 12:07:58.537973 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:07:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:07:59.061693 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-c8dd45e3-78ee-427c-8dcc-32d7b33654c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:07:59.082378 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-c8dd45e3-78ee-427c-8dcc-32d7b33654c3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405796 Aug 26 12:07:59.082945 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Aug 26 12:07:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 26 12:08:00.217127 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:00.218129 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 26 12:08:00.218550 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:08:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:08:00.771531 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-ab0cf150-a2a5-4dce-85fc-ab69edb79a32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:08:00.789886 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-ab0cf150-a2a5-4dce-85fc-ab69edb79a32 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.431873 Aug 26 12:08:00.790420 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Aug 26 12:08:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:08:01.750979 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:01.752008 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 26 12:08:01.752398 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:08:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:08:02.277539 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-a7014b9e-2b6f-4fd2-90fa-2f654512f75e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:08:02.295661 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-a7014b9e-2b6f-4fd2-90fa-2f654512f75e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404366 Aug 26 12:08:02.296193 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Aug 26 12:08:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:08:03.257716 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:03.258712 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 26 12:08:03.259106 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:08:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:08:03.772280 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-75f25106-58fd-45a6-8584-6b6022062221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:08:03.790604 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-75f25106-58fd-45a6-8584-6b6022062221 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.395854 Aug 26 12:08:03.791138 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Fri Aug 26 12:08:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:08:04.760196 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:04.761221 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 26 12:08:04.761613 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:08:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:08:05.286220 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-8b79012a-3197-4c45-85aa-c24096d4bcfb admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:05.306646 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-8b79012a-3197-4c45-85aa-c24096d4bcfb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406567 Aug 26 12:08:05.307177 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Fri Aug 26 12:08:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:08:58.440844 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:58.441862 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-d2b8fbb1-e6c4-45b8-801c-7bfc0fb60ae4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 Aug 26 12:08:58.442266 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Fri Aug 26 12:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:08:58.453452 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:08:58.834347 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-0965871d-62b7-4d3b-88e6-f8db65b073df admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:58.854454 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-0965871d-62b7-4d3b-88e6-f8db65b073df admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406122 Aug 26 12:08:58.854988 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Fri Aug 26 12:08:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:08:58.877213 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG dbcounter [-] [105722] Writing DB stats nova_api:SELECT=14 {{(pid=105722) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:08:58.881100 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-a1f78d94-c4bc-4522-97db-d17af4ffd264 admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:58.888737 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-a1f78d94-c4bc-4522-97db-d17af4ffd264 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014110 Aug 26 12:08:58.889245 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Fri Aug 26 12:08:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:08:58.901002 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-35475a20-1f71-42c4-9b9e-14a2cf592787 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:58.908644 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-35475a20-1f71-42c4-9b9e-14a2cf592787 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011405 Aug 26 12:08:58.909147 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Fri Aug 26 12:08:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:08:58.920077 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:58.927905 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011298 Aug 26 12:08:58.928416 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Fri Aug 26 12:08:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:08:58.940535 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-108acc60-3bb6-4f32-aa68-5e49675650e4 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:08:58.947938 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-108acc60-3bb6-4f32-aa68-5e49675650e4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011531 Aug 26 12:08:58.948443 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Fri Aug 26 12:08:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:12:05.151431 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:05.152434 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Aug 26 12:12:05.152853 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:12:05.295331 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_api:SELECT=6 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:12:05.451502 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:05.454916 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:05.455417 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:05.455843 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:05.456550 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:05.456988 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:05.457402 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:05.490293 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-31700b57-4856-4f0b-b288-1bb8d01338c9 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196409 Aug 26 12:12:05.490848 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Aug 26 12:12:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:12:06.310161 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:06.311154 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Aug 26 12:12:06.311566 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:12:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:12:06.504853 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:06.508233 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:06.508698 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:06.509152 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:06.510437 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:06.510871 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:06.511309 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:06.530607 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-6038a795-adf4-405b-8b78-7cf0440cfaca admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076559 Aug 26 12:12:06.531078 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Aug 26 12:12:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:12:17.771884 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:17.772904 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 26 12:12:17.773298 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:12:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:12:17.916386 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_cell0:SELECT=4 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:12:17.917100 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_cell1:SELECT=4 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:12:17.917724 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG dbcounter [-] [105723] Writing DB stats nova_api:SELECT=8 {{(pid=105723) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:12:17.966498 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:17.969847 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:17.970314 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:17.970735 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:17.971461 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:17.971899 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:17.972311 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:17.997938 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-8238d84c-57b2-45b6-8970-617c937e2030 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086445 Aug 26 12:12:17.998405 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Aug 26 12:12:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:12:18.823306 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: DEBUG nova.api.openstack.wsgi [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] Calling method '>' {{(pid=105722) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:18.824314 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: INFO nova.api.openstack.requestlog [None req-dac2bb34-41f3-4682-a22c-19fa89d9e7fc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Aug 26 12:12:18.824711 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: [pid: 105722|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Fri Aug 26 12:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:12:19.014944 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG nova.api.openstack.wsgi [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] Calling method '>' {{(pid=105723) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:12:19.018282 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:19.018742 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:19.019165 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:19.019911 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:12:19.020328 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:12:19.020741 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: DEBUG oslo_concurrency.lockutils [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105723) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:12:19.043802 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: INFO nova.api.openstack.requestlog [None req-261d9548-5b65-4c8a-b1f5-a460a227ab25 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080184 Aug 26 12:12:19.044350 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: [pid: 105723|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Fri Aug 26 12:12:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:13:17.593033 dv-cinder-846303-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 26 12:13:17.593554 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: Fri Aug 26 12:13:17 2022 - graceful shutdown triggered... Aug 26 12:13:17.593973 dv-cinder-846303-2-iscsi devstack@n-api.service[105722]: Gracefully killing worker 1 (pid: 105722)... Aug 26 12:13:17.594482 dv-cinder-846303-2-iscsi devstack@n-api.service[105723]: Gracefully killing worker 2 (pid: 105723)... Aug 26 12:13:18.594509 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: worker 1 buried after 1 seconds Aug 26 12:13:18.595038 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: worker 2 buried after 1 seconds Aug 26 12:13:18.595038 dv-cinder-846303-2-iscsi devstack@n-api.service[105721]: goodbye to uWSGI. Aug 26 12:13:18.596088 dv-cinder-846303-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 26 12:13:18.596639 dv-cinder-846303-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 26 12:13:18.599491 dv-cinder-846303-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 26 12:13:18.610367 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 12:13:18 2022] *** Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: nodename: dv-cinder-846303-2-iscsi Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: machine: x86_64 Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: clock source: unix Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: pcre jit disabled Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: detected number of CPU cores: 4 Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: current working directory: / Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: detected binary path: /usr/bin/uwsgi-core Aug 26 12:13:18.612336 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: your processes number limit is 47680 Aug 26 12:13:18.613214 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: your memory page size is 4096 bytes Aug 26 12:13:18.613214 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: detected max file descriptor number: 2048 Aug 26 12:13:18.613214 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: lock engine: pthread robust mutexes Aug 26 12:13:18.613214 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: thunder lock: enabled Aug 26 12:13:18.613214 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 26 12:13:18.613214 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 12:13:18.652539 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: Python main interpreter initialized at 0x5560ad38c9c0 Aug 26 12:13:18.652539 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: python threads support enabled Aug 26 12:13:18.652539 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: your server socket listen backlog is limited to 100 connections Aug 26 12:13:18.652539 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: your mercy for graceful operations on workers is 90 seconds Aug 26 12:13:18.652921 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 12:13:18.653004 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: *** Operational MODE: preforking *** Aug 26 12:13:18.653259 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: *** uWSGI is running in multiple interpreter mode *** Aug 26 12:13:18.653259 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: spawned uWSGI master process (pid: 120677) Aug 26 12:13:18.653452 dv-cinder-846303-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 26 12:13:18.656175 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: spawned uWSGI worker 1 (pid: 120696, cores: 1) Aug 26 12:13:18.656175 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: spawned uWSGI worker 2 (pid: 120698, cores: 1) Aug 26 12:13:18.656511 dv-cinder-846303-2-iscsi devstack@n-api.service[120677]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 12:13:19.319465 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 12:13:19.321553 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 26 12:13:20.468594 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:13:20.468594 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: from cryptography.utils import int_from_bytes Aug 26 12:13:20.469249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:13:20.469249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: from cryptography.utils import int_from_bytes Aug 26 12:13:20.477861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:13:20.477861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: from cryptography.utils import int_from_bytes Aug 26 12:13:20.478394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 12:13:20.478394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: from cryptography.utils import int_from_bytes Aug 26 12:13:22.861196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 12:13:22.861766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 12:13:22.861991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 12:13:22.862355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 12:13:22.862608 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 12:13:22.862997 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.863353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.863670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.863986 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.865182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.865182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.865182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.865530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.865807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.866063 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.866391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.866715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-2-iscsi {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.867022 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.867371 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.867883 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.868334 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.868897 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.869229 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.869557 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.870068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.873967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.874805 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.874805 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.875151 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-2-iscsi {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.875342 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.875651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.875968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.876391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.876702 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.877009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.877330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.877655 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.877964 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.878291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.878610 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.878930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.879267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.879573 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.879879 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.880227 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.880546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.880850 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.881152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.881401 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.881733 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.882054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.882373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.882881 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.883980 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.883980 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.884253 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.884567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.884866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.885176 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.885482 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.885788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.886091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.886394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.886694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.886997 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.887332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.887647 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.887964 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.888266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.888584 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.888981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.889231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.889538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.889653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 12:13:22.890058 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 12:13:22.890143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.890216 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.890382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 12:13:22.890515 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.890688 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 12:13:22.890846 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.890985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 12:13:22.891116 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.891350 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.891505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.891677 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.891825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.891981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.892098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.892299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.892392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.892630 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.892756 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.892930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.893075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.893175 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.893401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.893505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.893724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.893822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.894055 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.894152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.894319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.894424 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.894634 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.894735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.894935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.895032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846303-2-iscsi {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.895249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.895359 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.895556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.895656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.895860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.895961 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.896162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.896266 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.896466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.896575 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.896766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.896868 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.897066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.897169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.897367 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.897572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.897678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.897885 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.897988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.898192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.898290 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.898501 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.898604 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.899546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.899667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.899854 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.900055 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.900175 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.900376 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.900483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.900701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.900797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.901014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.901167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.901319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.901460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.901640 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.901795 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.901952 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.902118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846303-2-iscsi {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.902265 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.902425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.902567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.902724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.902867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.903015 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.903164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.903358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.903518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.903661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.903802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.903952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.904101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.904268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.904420 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.904579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.904740 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.905063 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.905223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.905365 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.905526 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.905705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.905857 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.906011 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.906162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.906304 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.906466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.906717 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.906869 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.907010 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.907158 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.907357 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.907501 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.907653 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.907801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.907944 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.908084 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.908233 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.908374 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.908525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.908673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.908814 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.908961 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.909116 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.909258 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.909398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.909538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.909766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.909924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.909924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.910296 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.910456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.910599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.910754 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.911973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.912128 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.912283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.912436 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.912587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.912587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.912869 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.913010 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.913172 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.913172 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.913462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.914196 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.914346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.914496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.914639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.914792 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.915191 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.915376 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.915519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.915659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.915825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.915969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.916122 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.916277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.916419 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.916567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.917022 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.917022 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.917464 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.917788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.917788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.918069 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.918217 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.918366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.918515 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.918656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.918806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.918955 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.919106 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.919287 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.919447 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.919596 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.919772 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.919920 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.920069 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.920165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.920245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.920324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.920408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.920497 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.920586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.920679 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.920762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.920855 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.920939 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.921020 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.921101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.921189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.921189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.921189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.921189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.921499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.921594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.921678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.921758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.921848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.921972 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.922081 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.922181 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.922265 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.922355 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.922355 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.922581 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.922673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.922764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.922853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.922853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.922853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.923097 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.923185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.923296 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.923962 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.924091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.924191 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.924276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.924357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.924438 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.924527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.924624 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.924708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.924944 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.925038 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.925310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.925415 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.925573 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.925667 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.925880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.925988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.926199 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.926299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.926505 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.926597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.926811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.926912 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.927133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.927320 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.927463 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.927556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.927769 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.927861 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.928086 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.928180 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.928394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.928495 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.928701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.928806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.929018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.929119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.929320 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.929422 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.929626 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.929726 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.929987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.930116 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.930398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.930504 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.930747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.930850 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.930998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.931092 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.931343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.931452 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.931652 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.931754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.931958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.932059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.932262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.932355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.932559 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.932814 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.932922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.933150 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.933246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.933460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.933562 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.933769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.933871 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.934075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.934167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.934380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.934486 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.934690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.934788 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 12:13:22.935028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.935338 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.935461 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.935618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.935705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.935903 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.936003 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.936242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.936353 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.936554 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.936654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.936890 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.936992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.937224 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.937341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.937531 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.937648 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.937857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.937950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.938167 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.938270 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.938479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.938579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.938781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.938872 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.939373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.939514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.939616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.939843 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.939936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.940156 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.940258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.940470 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.940567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.940779 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.940878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.941434 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.941554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.941629 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.941698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.941766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.941845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.942046 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.942212 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.942354 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.942500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.942640 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.942816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.942971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.943077 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.943298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.943408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.943628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.943730 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.943952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.944046 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.944267 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.944366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.944588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.944700 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.944901 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.944995 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.945224 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.945351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.946124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.946393 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.946504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.946702 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.947651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.947815 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.947969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.948118 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.948269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.948269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.948545 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.948692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.948835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.948984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.949144 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.949285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.949424 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.949562 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.949698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.949698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.949962 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.950093 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.950093 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.950093 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.950460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.950609 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.950757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.950925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.951072 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.951258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.951419 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.951574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.951714 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.951853 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.951993 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.952132 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.952289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.952430 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.952580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.952745 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.953147 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.953301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.953457 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.953605 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.953746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.953885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.954026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.954172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.954321 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.954473 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.954613 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.954760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.954908 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.955068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.955237 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.955385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.955525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.955762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.955918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.956060 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.956227 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.956450 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.957074 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.957229 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.957378 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.957534 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.957686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.957826 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.957973 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.958114 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.958367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.958522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.958671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.958820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.958960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.959106 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.959323 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.959488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.959647 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.959788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.959927 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.960084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.960225 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.960379 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.960520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.960660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.960805 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.960952 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.961101 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.961286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.962036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.962289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.962463 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.962615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.962771 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.962924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.963247 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.963247 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.963644 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.963797 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.963951 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.964099 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.964240 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.964379 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.964537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.964686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.964839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.964987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.965135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.965276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.965416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.965564 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.965705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.965943 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.966097 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.966246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.966394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.966649 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.966797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.966944 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.967091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.967292 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.967448 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.967665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.967818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.967959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.968098 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.968238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.968238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.968523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.968664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.968811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.968952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.969091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.969243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.969392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.969539 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.969687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.969828 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.969828 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.970123 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.970273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.970429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.970569 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.970708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.970856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.971005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.971152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.971327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.971477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.971616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.971762 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.971911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.972052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.972190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.972339 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.972479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.972626 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.972773 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.972914 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.973078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.973889 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.974054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.974206 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.974357 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.974497 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.974637 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.974784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.974936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.975099 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.975289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.975446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.975587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.975733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.975873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.976108 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.976264 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.976414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.976555 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.976783 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.977048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.977216 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.977216 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.977501 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.977642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.977789 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.977938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.978080 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.978229 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.978377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.978518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.978664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.978818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.978974 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.979116 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.979296 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.979444 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.979592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.979733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.979872 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.980018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.980172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.980321 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.980469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.980616 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.980755 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.980904 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.981057 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.981205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.981347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.981485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.981631 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.981771 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.981923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.982064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.982203 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.982342 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.982489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.982489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.982772 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.982921 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.983067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.983232 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.983546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.983810 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.983969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.984110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.984256 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.984398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.984544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.984698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.984840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.984991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.985131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.985270 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.985409 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.985563 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.985711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.985860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.986017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.986251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.986414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.986557 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.986706 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.987397 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.987562 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.987705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.987853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.987995 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.988142 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.988142 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.988407 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.988554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.988554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.988841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.988988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.989135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.989301 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.989450 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.989599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.989748 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.989889 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.990044 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.990186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.990339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.990339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.990605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.990605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.990878 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.991026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.991248 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.991398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.991538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.991689 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.991837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.991978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.992131 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.992278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.992426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.992666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.992820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.992970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.993120 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.993120 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.993414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.994048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.994193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.994344 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.994493 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.994635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.994790 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.994933 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.995081 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.995250 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.995398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.995550 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.995702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.995702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.995969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.996122 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.996280 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.996498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.996498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.996498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.996902 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.997145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.997299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.997447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.997599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.997739 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.997888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.998030 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.998170 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.998310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.998457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.998598 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.998812 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.998962 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.999149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.999373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.999516 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.999668 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.999818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:22.999986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.000130 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.000276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.000424 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.000424 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.000707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.000857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.000857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.001130 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.001278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.001437 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.001590 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.001729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.001869 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.002016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.002164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.002318 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.002460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.002612 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.002761 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.002910 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.003057 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.003220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.003383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.003523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.003773 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.003940 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.004246 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.004408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.004985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.005141 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.005363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.005516 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.005673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.005815 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.005980 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.006821 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.006821 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.007142 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.007432 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.007594 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.007744 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.007886 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.008035 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.008694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.008838 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.008979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.009118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.009272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.009425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.009567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.009715 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.009854 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.010000 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.010156 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.010305 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.010457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.010606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.010748 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.010886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.011034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.011174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.011358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.011507 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.011656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.011806 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.011961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.012109 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.012249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.012388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.012535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.012683 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.012834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.012974 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.013123 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.013269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.013410 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.013562 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.013726 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.013946 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.014111 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.014416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.014567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.014728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.014871 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.015011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.015150 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.015344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.015487 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.015638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.015787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.015928 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.016068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.016213 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.016363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.016510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.016740 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.016897 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.017119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.017276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.017459 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.017670 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.017823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.017966 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.018114 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.018262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.018416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.018558 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.018697 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.018837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.018978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.019118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.019291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.019453 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.019601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.019748 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.019889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.020036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.020179 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.020336 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.020479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.020626 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.020767 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.020915 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.021063 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.021221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.021363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.021519 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.021673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.021833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.021987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.022143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.022291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.022445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.022594 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.022749 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.022749 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.023045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.023219 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.023375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.023534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.023692 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.024682 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.024834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.024975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.025123 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.025273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.025423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.025571 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.025713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.025861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.026016 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.026166 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.026315 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.026463 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.026611 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.026777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.026989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.027145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.027347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.027492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.027648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.027877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.028522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.028687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.028837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.028837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.029104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.029104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.029379 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.029528 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.029670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.029670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.029941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.030091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.030240 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.030240 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.030542 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.030684 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.030825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.030965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.031120 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.031284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.031443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.031594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.031735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.031888 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.032029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.032178 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.032331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.032472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.032613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.032762 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.032912 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.033059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.033208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.033356 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.033504 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.033660 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.033816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.033972 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.034120 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.034277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.034432 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.034865 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.035032 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.035190 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.035364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.035512 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.035670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.035833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.035982 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.036136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.036283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.036431 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.036665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.036817 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.036983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.037211 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.037373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.037521 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.037683 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.037850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.038073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.038226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.038226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.038526 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.038694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.038850 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.038998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.039145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.039401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.039567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.039725 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.039874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.040022 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.040169 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.040332 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.040495 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.040651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.040816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.040963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.041111 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.041257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.041412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.041560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.041714 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.041861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.042009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.042157 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.042312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.042468 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.042623 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.042781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.042936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.043092 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.043275 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.043438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.043587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.043741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.043889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.044044 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.044194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.044341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.044488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.044636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.045067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.045237 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.045386 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.045534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.045682 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.045842 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.045991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.046139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.046286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.046440 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.046587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.046747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.046914 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.047062 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.047284 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.047441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.047599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.047760 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.047908 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.048079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.048308 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.048470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.048626 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.048782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.048937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.049108 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.049256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.049412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.049569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.049717 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.049871 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.050019 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.050179 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.050331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.050510 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.051178 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.051358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.051508 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.051667 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.051814 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.051978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.052134 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.052296 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.052453 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.052603 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.052758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.052920 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.053070 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.053218 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.053365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.053512 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.053682 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.053840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.053988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.054135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.054282 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.054429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.054589 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.054739 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.054904 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.055387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.055560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.055718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.055891 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.056041 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.056188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.056342 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.056490 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.056638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.056795 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.056942 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.057089 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.057244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.057392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.057547 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.057696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.057863 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.058011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.058158 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.058331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.058648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.058808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.058958 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.059113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.059292 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.059447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.059675 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.059826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.059974 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.060150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.060310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.060457 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.060620 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.060769 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.060916 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.061071 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.061226 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.061382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.061530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.061676 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.061831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.061989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.062145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.062307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.062475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.062625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.062625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.062910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.063067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.063270 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.063438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.063587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.063734 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.063734 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.064031 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.064188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.064338 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.064484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.064630 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.064784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.064945 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.065093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.065416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.065673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.065830 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.065978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.066139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.066307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.066456 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.066610 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.066765 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.066912 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.067070 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.067239 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.067394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.067542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.067690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.067855 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.068010 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.068168 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.068318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.068464 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.068707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.068877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.069026 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.069181 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.069181 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.069480 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.069639 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.069796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.069944 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.070119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.070276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.070432 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.071100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.071312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.071479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.071629 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.071776 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.071924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.072079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.072236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.072390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.072538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.072703 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.072851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.073011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.073167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.073315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.073469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.073625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.073787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.073936 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.074091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.074246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.074246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.074551 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.074709 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.074857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.075004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.075162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.075347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.075347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.075903 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.076067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.076217 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.076372 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.076372 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.076659 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.076827 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.076827 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.077124 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.077279 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.077426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.077586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.077742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.077891 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.078038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.078185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.078331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.078491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.078658 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.078898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.079059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.079254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.079421 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.079579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.079735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.079883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080493 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.080831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.081923 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.082082 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.082230 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.082385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.082540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.082699 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.082854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.083011 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.083166 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.083340 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.083499 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.083648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.083796 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.083796 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.084087 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.084235 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.084382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.084536 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.084706 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.084853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.084853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.085148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.085303 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.085458 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.085778 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.086038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.086229 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.086919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.087069 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.087237 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.087417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.087576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.087724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.087878 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.088025 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.088182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.088331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.088487 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.088643 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.088792 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.089023 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.089192 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.089353 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.089500 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.089500 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.089787 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.090015 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.090173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.090323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.090483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.090643 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.090800 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.090800 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.091090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.091090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.091430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.091586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.091744 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.091900 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.092048 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.092202 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.092348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.092348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.092644 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.092807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.092807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.093105 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.093262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.093418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.093574 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.093722 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.093876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.094030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.094184 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.094340 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.094502 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.094657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.094803 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.094950 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.095103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.095288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.095452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.095601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.095601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.095601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.096284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.096284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.096284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.096715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.096878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.097038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.097186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.097358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.097514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.097671 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.097826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.097973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.098127 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.098288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.098437 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.098592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.098741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.098741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.099040 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.099324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.099324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.099627 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.099783 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.099930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.100077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.100077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.100077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.100077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.100651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.100651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.100946 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.101095 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.101248 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.101413 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.101568 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.101724 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.101918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.102086 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.102244 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.102400 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.102608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.102770 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.102932 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.103082 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.103260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.103427 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.103582 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.103739 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.103895 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.104045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.104192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.104347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.104495 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.104650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.104798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.104945 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.105100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.105247 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.105409 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.105569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.105718 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.106030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.106192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.106448 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.106606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.106768 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.106918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.107064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.107238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.107395 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.107559 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.107719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.107866 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108013 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108465 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108613 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108758 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108911 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.108911 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.109207 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.109455 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.109619 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.109767 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.109913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.110060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.110206 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.110366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.110529 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.110681 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.110828 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.110975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.111130 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.111338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.111489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.111646 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.111805 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.111964 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.112126 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.112275 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.112431 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.112578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.112578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.112866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.113024 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.113179 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.113328 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.113486 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.113633 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.113793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.113941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.114095 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.114243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.114390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.114538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.114703 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.114860 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.115008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.115008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.115312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.115474 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.115638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.115786 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.115933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.116243 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.116408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.116679 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.116833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.116981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.117129 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.117276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.117432 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.117638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.117853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.118018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.118167 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.118315 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.118461 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.118875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.119034 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.119190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.119364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.119364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.119738 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.119971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.120133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.120281 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.120428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.120597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.120757 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.120905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.121060 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.121208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.121362 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.121517 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.121679 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.121829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.121983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.122150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.122306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.122454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.122610 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.122758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.122920 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.123068 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.123252 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.123423 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.123573 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.123720 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.123867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.124023 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.124171 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.124325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.124480 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.124633 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.124787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.124944 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.125099 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.125254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.125401 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.125555 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.125709 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.125856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.126013 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.126316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.126484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.126649 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.126896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.127059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.127235 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.127391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.127539 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.127686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.127846 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.127994 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.128160 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.128309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.128309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.128309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.128717 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.128863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.129023 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.129180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.129180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.129467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.129638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.129864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.130018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.130182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.130337 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.130492 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.130644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.130799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.130947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.131094 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.131307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.131470 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.131625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.131781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.131930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.132090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.132238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.132392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.132538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.132698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.132854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.133001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.133668 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.133827 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.133985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.134134 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.134289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.134447 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.134613 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.134769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.134929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.135078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.135242 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.135409 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.135557 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.135705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.135865 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.136014 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.136168 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.136470 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.136639 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.136806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.137060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.137225 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.137373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.137528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.137684 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.137840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.137988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.138135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.138281 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.138428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.138582 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.138582 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.138894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.139050 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.139197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.139421 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.139569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.139730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.139730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.140104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.140257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.140404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.140565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.140714 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.140879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.141039 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.141188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.141343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.141499 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.141647 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.141801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.141948 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.142095 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.142242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.142398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.142553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.142718 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.142874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143023 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.143366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.144472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.146171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.147659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.147659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.147659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.147659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.147659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.147659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.148494 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.148494 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.149394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.149621 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.149976 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.150312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.150630 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.150945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.152240 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 12:13:23.152240 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 12:13:23.201541 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Registered counter for database nova_api Aug 26 12:13:23.215501 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Registered counter for database nova_api Aug 26 12:13:23.221655 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.228630 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.236132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.243368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.285408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.context [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e12ffa3-4320-4138-9a47-c092f122fe94(cell1) {{(pid=120696) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 12:13:23.289375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:13:23.290519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:13:23.292359 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:13:23.293096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:13:23.293542 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:13:23.295595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:13:23.297595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Registered counter for database nova_cell0 Aug 26 12:13:23.299572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.context [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2e12ffa3-4320-4138-9a47-c092f122fe94(cell1) {{(pid=120698) load_cells /opt/stack/nova/nova/context.py:464}} Aug 26 12:13:23.301633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Registered counter for database nova_cell1 Aug 26 12:13:23.303569 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:13:23.304046 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:13:23.306259 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:13:23.307008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:13:23.307485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:13:23.309520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:13:23.309687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.311623 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Registered counter for database nova_cell0 Aug 26 12:13:23.311902 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.315651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Registered counter for database nova_cell1 Aug 26 12:13:23.317282 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.319372 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.323531 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.324890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.331641 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.332919 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.466061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Registered counter for database nova_cell0 Aug 26 12:13:23.472778 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.478080 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.480952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Registered counter for database nova_cell0 Aug 26 12:13:23.488831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 12:13:23.494508 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 12:13:23.810580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:13:23.818275 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:13:23.835602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:13:23.843880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:13:24.171087 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:13:24.177345 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-f0177e23-9474-42f3-a793-d89565cea66c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:13:24.183335 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560ad38c9c0 pid: 120696 (default app) Aug 26 12:13:24.201085 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 26 12:13:24.207424 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-577fdfee-9927-4188-8d27-a2bddeda4f31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 26 12:13:24.212700 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560ad38c9c0 pid: 120698 (default app) Aug 26 12:14:00.376292 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:00.377104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:00.377837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:00.378549 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:02.192086 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1b7dcab0-db81-4173-966f-80b4b613513e tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Action: 'create', calling method: .version_select at 0x7ffa987969d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1246343917", "metadata": {"Type": "work"}}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1b7dcab0-db81-4173-966f-80b4b613513e tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Request method failure captured: Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 122 Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkI8g7PRQhYNQq-oY5sEmPfAody-C-TjugXP4xzJtf4MX6Htrct9EOZ21CGv4zkVaxhI3wpdqzFaIWFsUz1O3zQczd7w4CIsbqTXWJSWKA929TQ8iSbQRWDVmGyhLL-3jp0vFhcsivyHpvSxfRc4LQPKzuwUzR5lAg0y5lVn9qrF_o Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:14:02.231137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aff0bc2a1f414ae2ad59f54e2bb5ff36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: cee554500b02434c8c5aad6d498bc287 Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1246343917", "metadata": {"Type": "work"}}} Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: Aug 26 12:14:02.232975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1246343917', 'metadata': {'Type': 'work'}}}} Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise error Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi '#$%' Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:14:02.233987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 12:14:02.235660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 12:14:02.236935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 26 12:14:02.236935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.236935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1b7dcab0-db81-4173-966f-80b4b613513e tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:14:02.236935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1b7dcab0-db81-4173-966f-80b4b613513e tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.870130 Aug 26 12:14:02.236935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1156 bytes} [Fri Aug 26 12:14:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1872 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:14:02.550716 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24537c01-c76e-4512-b8f0-444436b5df61 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Action: 'create', calling method: .version_select at 0x7ffa988c64c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1239111563", "metadata": {"Type": "work"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24537c01-c76e-4512-b8f0-444436b5df61 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Request method failure captured: Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 120 Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkI8g7PRQhYNQq-oY5sEmPfAody-C-TjugXP4xzJtf4MX6Htrct9EOZ21CGv4zkVaxhI3wpdqzFaIWFsUz1O3zQczd7w4CIsbqTXWJSWKA929TQ8iSbQRWDVmGyhLL-3jp0vFhcsivyHpvSxfRc4LQPKzuwUzR5lAg0y5lVn9qrF_o Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:14:02.557799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aff0bc2a1f414ae2ad59f54e2bb5ff36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: cee554500b02434c8c5aad6d498bc287 Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1239111563", "metadata": {"Type": "work"}}} Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: Aug 26 12:14:02.559149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1239111563', 'metadata': {'Type': 'work'}}}} Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi '0' Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:14:02.559951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 12:14:02.561250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 12:14:02.562365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 26 12:14:02.562365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.562365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24537c01-c76e-4512-b8f0-444436b5df61 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:14:02.562365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24537c01-c76e-4512-b8f0-444436b5df61 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.318650 Aug 26 12:14:02.570360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4df6040a-1c3b-450a-886a-5677b66e104a tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Action: 'create', calling method: .version_select at 0x7ffa98796a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1636176208", "metadata": {"Type": "work"}}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:02.575009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1/2] 10.222.0.61 () {60 vars in 1156 bytes} [Fri Aug 26 12:14:02 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 325 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4df6040a-1c3b-450a-886a-5677b66e104a tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Request method failure captured: Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 119 Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkI8g7PRQhYNQq-oY5sEmPfAody-C-TjugXP4xzJtf4MX6Htrct9EOZ21CGv4zkVaxhI3wpdqzFaIWFsUz1O3zQczd7w4CIsbqTXWJSWKA929TQ8iSbQRWDVmGyhLL-3jp0vFhcsivyHpvSxfRc4LQPKzuwUzR5lAg0y5lVn9qrF_o Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:14:02.575580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aff0bc2a1f414ae2ad59f54e2bb5ff36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: cee554500b02434c8c5aad6d498bc287 Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1636176208", "metadata": {"Type": "work"}}} Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: Aug 26 12:14:02.576840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1636176208', 'metadata': {'Type': 'work'}}}} Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise error Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi '' Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:14:02.577596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 26 12:14:02.578862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 26 12:14:02.581528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 26 12:14:02.581528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:14:02.581528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4df6040a-1c3b-450a-886a-5677b66e104a tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:14:02.581528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4df6040a-1c3b-450a-886a-5677b66e104a tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010788 Aug 26 12:14:02.582380 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1156 bytes} [Fri Aug 26 12:14:02 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 26 12:14:02.588544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86a30b1e-1c8b-4820-8c11-483d9e21a434 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Calling method '.version_select at 0x7ffa987daf70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:02.653458 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:02.655110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:02.656644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:02.660702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:03.208455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b0c357de-067d-491e-bfc8-2c13ce175278 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa9864c550>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:03.307104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-86a30b1e-1c8b-4820-8c11-483d9e21a434 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] HTTP exception thrown: Volume tempest-invalid-393252148 could not be found. Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86a30b1e-1c8b-4820-8c11-483d9e21a434 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Request method failure captured: Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-393252148 HTTP/1.1 Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkI8g7PRQhYNQq-oY5sEmPfAody-C-TjugXP4xzJtf4MX6Htrct9EOZ21CGv4zkVaxhI3wpdqzFaIWFsUz1O3zQczd7w4CIsbqTXWJSWKA929TQ8iSbQRWDVmGyhLL-3jp0vFhcsivyHpvSxfRc4LQPKzuwUzR5lAg0y5lVn9qrF_o Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:14:03.319705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aff0bc2a1f414ae2ad59f54e2bb5ff36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: cee554500b02434c8c5aad6d498bc287 Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Volume tempest-invalid-393252148 could not be found. Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'tempest-invalid-393252148'} Aug 26 12:14:03.321296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-393252148 could not be found. (HTTP 404) (Request-ID: req-cc05ac82-7c0d-4e59-89c2-16cbb7a96177) Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.322705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 12:14:03.323947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-393252148 could not be found. Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:14:03.325098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-393252148 could not be found. Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-393252148 could not be found. Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.326262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86a30b1e-1c8b-4820-8c11-483d9e21a434 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Returning 404 to user: Volume tempest-invalid-393252148 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:14:03.326904 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86a30b1e-1c8b-4820-8c11-483d9e21a434 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-393252148" status: 404 len: 98 microversion: 2.1 time: 0.739261 Aug 26 12:14:03.331466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1215 bytes} [Fri Aug 26 12:14:02 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-393252148 => generated 98 bytes in 748 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 26 12:14:03.354203 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ddfd472-84a6-4119-847f-5e927a1b2c35 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012519 Aug 26 12:14:03.359941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1140 bytes} [Fri Aug 26 12:14:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 12:14:03.379346 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d89a5bea-4862-40c4-9358-2644435e3066 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014980 Aug 26 12:14:03.381550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 4/6] 10.222.0.61 () {58 vars in 1137 bytes} [Fri Aug 26 12:14:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 26 12:14:03.400958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d18c9be0-9121-403c-aafd-244ed90b2dce tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Calling method '.version_select at 0x7ffa986008b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:03.480998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d18c9be0-9121-403c-aafd-244ed90b2dce tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] HTTP exception thrown: Volume deb03fd4-20a4-4277-a066-b233765268d2 could not be found. Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d18c9be0-9121-403c-aafd-244ed90b2dce tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Request method failure captured: Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-volumes/deb03fd4-20a4-4277-a066-b233765268d2 HTTP/1.1 Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkI8g7PRQhYNQq-oY5sEmPfAody-C-TjugXP4xzJtf4MX6Htrct9EOZ21CGv4zkVaxhI3wpdqzFaIWFsUz1O3zQczd7w4CIsbqTXWJSWKA929TQ8iSbQRWDVmGyhLL-3jp0vFhcsivyHpvSxfRc4LQPKzuwUzR5lAg0y5lVn9qrF_o Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:14:03.484245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aff0bc2a1f414ae2ad59f54e2bb5ff36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: cee554500b02434c8c5aad6d498bc287 Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Volume deb03fd4-20a4-4277-a066-b233765268d2 could not be found. Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'deb03fd4-20a4-4277-a066-b233765268d2'} Aug 26 12:14:03.485905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume deb03fd4-20a4-4277-a066-b233765268d2 could not be found. (HTTP 404) (Request-ID: req-2556fc53-48bb-48ab-bb23-3b51e3ab8950) Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.486724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 12:14:03.487854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume deb03fd4-20a4-4277-a066-b233765268d2 could not be found. Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 12:14:03.490975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume deb03fd4-20a4-4277-a066-b233765268d2 could not be found. Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume deb03fd4-20a4-4277-a066-b233765268d2 could not be found. Aug 26 12:14:03.495268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.499329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d18c9be0-9121-403c-aafd-244ed90b2dce tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Returning 404 to user: Volume deb03fd4-20a4-4277-a066-b233765268d2 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:14:03.500572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d18c9be0-9121-403c-aafd-244ed90b2dce tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/deb03fd4-20a4-4277-a066-b233765268d2" status: 404 len: 109 microversion: 2.1 time: 0.111921 Aug 26 12:14:03.505786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 5/7] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:14:03 2022] DELETE /compute/v2.1/os-volumes/deb03fd4-20a4-4277-a066-b233765268d2 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:14:03.521781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffe30563-40d2-4907-b851-d20c5debd208 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Calling method '.version_select at 0x7ffa98600c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:03.589136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ffe30563-40d2-4907-b851-d20c5debd208 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] HTTP exception thrown: Volume 90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 could not be found. Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffe30563-40d2-4907-b851-d20c5debd208 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Request method failure captured: Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/os-volumes/90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 HTTP/1.1 Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkI8g7PRQhYNQq-oY5sEmPfAody-C-TjugXP4xzJtf4MX6Htrct9EOZ21CGv4zkVaxhI3wpdqzFaIWFsUz1O3zQczd7w4CIsbqTXWJSWKA929TQ8iSbQRWDVmGyhLL-3jp0vFhcsivyHpvSxfRc4LQPKzuwUzR5lAg0y5lVn9qrF_o Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:14:03.591661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aff0bc2a1f414ae2ad59f54e2bb5ff36", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aff0bc2a1f414ae2ad59f54e2bb5ff36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: aff0bc2a1f414ae2ad59f54e2bb5ff36 Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1406361949 Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: cee554500b02434c8c5aad6d498bc287 Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1406361949-project Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Volume 90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 could not be found. Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348'} Aug 26 12:14:03.593186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 could not be found. (HTTP 404) (Request-ID: req-e6adb6d0-4781-4108-aaec-f692edc61b2e) Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.594133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:14:03.595297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 could not be found. Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 12:14:03.598059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 could not be found. Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 could not be found. Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffe30563-40d2-4907-b851-d20c5debd208 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] Returning 404 to user: Volume 90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ffe30563-40d2-4907-b851-d20c5debd208 tempest-VolumesNegativeTest-1406361949 tempest-VolumesNegativeTest-1406361949-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348" status: 404 len: 109 microversion: 2.1 time: 0.084959 Aug 26 12:14:03.599174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 6/8] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:14:03 2022] GET /compute/v2.1/os-volumes/90c6cd6a-3a8e-42cc-ba7a-1a71c7c46348 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:14:03.849256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b0c357de-067d-491e-bfc8-2c13ce175278 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/37b91ed0-8194-4137-9afb-afdd3edf9fe2" status: 200 len: 351 microversion: 2.1 time: 0.659821 Aug 26 12:14:03.850262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 3/9] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:14:03 2022] GET /compute/v2.1/os-volumes/37b91ed0-8194-4137-9afb-afdd3edf9fe2 => generated 351 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:05.498278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-04ca7dcf-e6d9-477f-9769-b0db21d30363 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa985cfee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:05.609443 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-04ca7dcf-e6d9-477f-9769-b0db21d30363 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a72accca-48b8-482b-9c38-13f3cbd09a9c" status: 200 len: 350 microversion: 2.1 time: 0.121203 Aug 26 12:14:05.610435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 7/10] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:14:05 2022] GET /compute/v2.1/os-volumes/a72accca-48b8-482b-9c38-13f3cbd09a9c => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:08.066192 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1c1704c2-1e3a-44c4-86de-181b80de8b09 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa98626dc0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:08.197452 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1c1704c2-1e3a-44c4-86de-181b80de8b09 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4078e46a-4e6f-4227-9568-e642dc0b3f83" status: 200 len: 349 microversion: 2.1 time: 0.134946 Aug 26 12:14:08.198117 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 4/11] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:14:08 2022] GET /compute/v2.1/os-volumes/4078e46a-4e6f-4227-9568-e642dc0b3f83 => generated 349 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:08.211309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-306eb170-8f34-44c7-a151-a79a1579c200 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa98608280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:08.527991 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-306eb170-8f34-44c7-a151-a79a1579c200 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.316296 Aug 26 12:14:08.529593 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 8/12] 10.222.0.61 () {58 vars in 1134 bytes} [Fri Aug 26 12:14:08 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:08.550142 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-76176aad-5aea-452c-ac4d-04d2462d1322 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa9864c1f0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:08.838297 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-76176aad-5aea-452c-ac4d-04d2462d1322 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.298434 Aug 26 12:14:08.838923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 5/13] 10.222.0.61 () {58 vars in 1149 bytes} [Fri Aug 26 12:14:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:08.853866 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e098b31-24b0-4cb0-a857-7d39f8924d4a tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa98600c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:09.039088 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e098b31-24b0-4cb0-a857-7d39f8924d4a tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.190364 Aug 26 12:14:09.048262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 9/14] 10.222.0.61 () {58 vars in 1134 bytes} [Fri Aug 26 12:14:08 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:09.055484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6973571c-13a4-4dfc-b7d0-e89746e4e33e tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa9863e040>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:09.258591 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6973571c-13a4-4dfc-b7d0-e89746e4e33e tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.208818 Aug 26 12:14:09.261363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 6/15] 10.222.0.61 () {58 vars in 1167 bytes} [Fri Aug 26 12:14:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:09.279603 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4239db68-c34a-4fc8-b17c-6e224ee4a601 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa98607040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:09.533165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4239db68-c34a-4fc8-b17c-6e224ee4a601 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.258961 Aug 26 12:14:09.534079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 10/16] 10.222.0.61 () {58 vars in 1170 bytes} [Fri Aug 26 12:14:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:14:09.551059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-27f92f72-6fde-4698-aca4-08eb550f13c5 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa98634b80>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:09.766380 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-27f92f72-6fde-4698-aca4-08eb550f13c5 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.221341 Aug 26 12:14:09.766972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 7/17] 10.222.0.61 () {58 vars in 1155 bytes} [Fri Aug 26 12:14:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:09.782697 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0392604a-63c5-4251-a89e-308111fedf60 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa9858d280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:10.101019 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0392604a-63c5-4251-a89e-308111fedf60 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.323510 Aug 26 12:14:10.101594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 11/18] 10.222.0.61 () {58 vars in 1188 bytes} [Fri Aug 26 12:14:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:10.116349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2acbf828-7532-4ec1-b49e-83abd53963b6 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] Calling method '.version_select at 0x7ffa9863eee0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:10.418378 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2acbf828-7532-4ec1-b49e-83abd53963b6 tempest-VolumesTestJSON-423539187 tempest-VolumesTestJSON-423539187-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.307222 Aug 26 12:14:10.420812 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 8/19] 10.222.0.61 () {58 vars in 1155 bytes} [Fri Aug 26 12:14:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:15.465075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1936075154", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:15.845116 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] validate_networks() for [('3b1347e6-c9cc-4abb-905a-84d42de7f611', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:14:17.740451 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-094e5e5b-c5f9-4477-a7a7-24c5710bc857 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'create', calling method: .version_select at 0x7ffa98641310>, body: {"keypair": {"name": "tempest-keypair-2142325436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQCXlq3PGWEpiKRG/qygXc7LhYcrFHKKq1Yseticvav6kJYGJjkkoxWesmwwez29WP6JXc05C2OzAva+pnLIR8AbsaL1i4N7pDizd5JGZthOe8EmTvKhunEoX2CqiaAvg=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:17.889764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-094e5e5b-c5f9-4477-a7a7-24c5710bc857 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:14:17.900569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-094e5e5b-c5f9-4477-a7a7-24c5710bc857 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for user 2d9f1a5e4e77467f8a691b634a841de2 and project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:14:18.014288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-094e5e5b-c5f9-4477-a7a7-24c5710bc857 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.552388 Aug 26 12:14:18.015956 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 9/20] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:14:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:19.114608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:14:19.115106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:14:19.116159 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:14:19.116685 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:14:19.117251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:14:19.147958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:19.151077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:19.151648 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:19.154493 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:19.156653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:19.158579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:19.207482 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for project 984b6ea268f04e8989283e6397b68370. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:14:19.215363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for user a02508c20bd547708638c1875101da6f and project 984b6ea268f04e8989283e6397b68370. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:14:19.232206 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:14:19.235840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:14:19.377582 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-06a22439-715e-459f-838c-627f69c706e3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.878864 Aug 26 12:14:19.378552 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 12/21] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:14:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:14:19.390555 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-240b63f4-7d8d-4c81-9198-4c7fa53c02fa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:19.391989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-240b63f4-7d8d-4c81-9198-4c7fa53c02fa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:19.764370 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-240b63f4-7d8d-4c81-9198-4c7fa53c02fa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:19.808055 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-240b63f4-7d8d-4c81-9198-4c7fa53c02fa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1222 microversion: 2.1 time: 0.421555 Aug 26 12:14:19.810241 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 10/22] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:19 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1222 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:20.293392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-927053913", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:20.574754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] validate_networks() for [('3b1347e6-c9cc-4abb-905a-84d42de7f611', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:14:21.193253 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-163d8cce-8a14-42e9-9b39-7df40bd9de44 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: .version_select at 0x7ffa98607280>, body: {"keypair": {"name": "tempest-keypair-1609549922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbKnhoysGRfXcBHU1wBDswtDSdczU6YZwVU3LofvLw6HEHvHReAK/6/hgsFOGeuwYuuk9VY+nOKlGGyCKKdD5xhetCigf9OqCNT5xTYVjvPb/O2z+CjpS9eetWj7yjj4g=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:21.262374 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-163d8cce-8a14-42e9-9b39-7df40bd9de44 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:14:21.273491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-163d8cce-8a14-42e9-9b39-7df40bd9de44 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:14:21.362763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-163d8cce-8a14-42e9-9b39-7df40bd9de44 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.244901 Aug 26 12:14:21.371571 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 13/23] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:14:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:22.300447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2142157655", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "networks": [{"uuid": "affc4e0e-61ae-4ed3-8489-e3c7618f256a"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:22.446564 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] validate_networks() for [('affc4e0e-61ae-4ed3-8489-e3c7618f256a', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:14:23.688339 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:14:23.688987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:14:23.689199 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:14:23.689600 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:14:23.690276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:14:23.707980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:23.712533 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:23.713173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:23.714126 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:23.714733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:23.717472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:23.763243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Getting quotas for project e58ce6250ef341b6bdc369d9475f0670. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:14:23.767757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Getting quotas for user ff96b716abcd4565866fc3c24cbe91e5 and project e58ce6250ef341b6bdc369d9475f0670. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:14:23.781537 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:14:23.784497 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:14:23.901510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94890155-8c10-4181-bc63-56698ae45bf0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.119704 Aug 26 12:14:23.903660 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 14/24] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:14:23.918100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-692480492", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbbcd3d6-4849-4648-a1f4-b172dd116d92"}], "security_groups": [{"name": "tempest-securitygroup--39466332"}], "key_name": "tempest-keypair-2142325436", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:23.974569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:14:23.975081 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:14:23.975802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:14:23.976112 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:14:23.976665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:14:24.006306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:24.006802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:24.008078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:24.009998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:24.010520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:24.010954 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:24.093346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for project 984b6ea268f04e8989283e6397b68370. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:14:24.100889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for user a02508c20bd547708638c1875101da6f and project 984b6ea268f04e8989283e6397b68370. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:14:24.140844 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:14:24.144746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:14:24.315352 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-066904cc-e496-4a40-8d48-8aa656af586f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.027847 Aug 26 12:14:24.324079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 11/25] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:14:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 4037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 12:14:24.354824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5469ec40-43f3-4ad1-b5e9-8149a370bc08 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:24.362198 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5469ec40-43f3-4ad1-b5e9-8149a370bc08 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:24.693188 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5469ec40-43f3-4ad1-b5e9-8149a370bc08 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:24.704359 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5469ec40-43f3-4ad1-b5e9-8149a370bc08 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1215 microversion: 2.1 time: 0.378767 Aug 26 12:14:24.708388 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 12/26] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:24 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1215 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:24.724560 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-693b5918-06ea-4ebf-a1c0-16aee7aca275 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:24.733637 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-693b5918-06ea-4ebf-a1c0-16aee7aca275 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:24.798784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] validate_networks() for [('bbbcd3d6-4849-4648-a1f4-b172dd116d92', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:14:25.143874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-693b5918-06ea-4ebf-a1c0-16aee7aca275 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:25.161372 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-693b5918-06ea-4ebf-a1c0-16aee7aca275 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1221 microversion: 2.1 time: 0.451387 Aug 26 12:14:25.172537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 13/27] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:24 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1221 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:25.733256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-10cafeec-1723-4c2c-a0f1-42e8bafcb6ed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:25.733958 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-10cafeec-1723-4c2c-a0f1-42e8bafcb6ed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:26.514933 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-10cafeec-1723-4c2c-a0f1-42e8bafcb6ed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:26.522800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-10cafeec-1723-4c2c-a0f1-42e8bafcb6ed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1215 microversion: 2.1 time: 0.794101 Aug 26 12:14:26.523403 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 14/28] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:25 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1215 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:26.536968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:26.547459 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:26.563803 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:26.566019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:26.572387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:26.574143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:26.574862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:26.580343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:26.879370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:14:26.880028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:14:26.880515 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:14:26.881915 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:14:26.882054 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:14:26.932079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:26.937943 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:26.942671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:26.951532 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:26.951532 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:26.952810 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:27.059689 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:14:27.078313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for user 2d9f1a5e4e77467f8a691b634a841de2 and project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:14:27.156685 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:14:27.163952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:14:27.309937 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8daaf0d4-58c4-4231-9080-fb058aeaa405 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.401545 Aug 26 12:14:27.318728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 15/29] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:14:23 2022] POST /compute/v2.1/servers => generated 400 bytes in 3414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:14:27.326550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a40c7356-3942-43e5-b8e1-83f58d520920 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:27.327671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a40c7356-3942-43e5-b8e1-83f58d520920 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:28.093460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:28.128192 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fb938716-09b0-4460-9b46-e7c6af2100fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1273 microversion: 2.1 time: 1.602604 Aug 26 12:14:28.130824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 15/30] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:26 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1273 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:28.151463 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:28.155069 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:28.177374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:28.182194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:28.183044 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:28.184038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:28.184746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:28.187430 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:28.235321 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a40c7356-3942-43e5-b8e1-83f58d520920 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:28.255788 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a40c7356-3942-43e5-b8e1-83f58d520920 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1237 microversion: 2.1 time: 0.935273 Aug 26 12:14:28.272127 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 16/31] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:27 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1237 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:28.323369 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:28.366820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8c592f84-b3c2-4a9c-a045-78f2ee749dd2 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1267 microversion: 2.1 time: 0.228358 Aug 26 12:14:28.370079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 16/32] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:28 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:29.044690 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1121066786", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7e62f88-9652-4f52-9fec-a02b6bfed4c3"}], "security_groups": [{"name": "tempest-securitygroup--174468130"}], "key_name": "tempest-keypair-1609549922", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:29.158068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:29.158764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:29.178340 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:29.180091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:29.184438 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:29.186851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:29.189678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:29.194236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:29.729200 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:29.774934 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5cfca89d-8a9e-46db-8f32-53c8fbb5cbec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1279 microversion: 2.1 time: 0.616333 Aug 26 12:14:29.785004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 17/33] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:29 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1279 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:29.842836 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:29.847556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:29.878707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:29.883975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:29.887891 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:29.890048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:29.894136 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:29.894822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:30.021162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] validate_networks() for [('c7e62f88-9652-4f52-9fec-a02b6bfed4c3', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:14:30.704731 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:30.714796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8855d727-7f6d-4dc1-a2f8-26f54aa2cfa8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1289 microversion: 2.1 time: 0.925167 Aug 26 12:14:30.738525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 18/34] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:29 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1289 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:30.752698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:30.753319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:30.806000 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:30.811975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:30.819270 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:30.823443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:30.830564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:30.834835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:31.223902 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:31.240166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-298a7d28-09f5-45e9-a4fb-c21e9a9a9472 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1273 microversion: 2.1 time: 0.500016 Aug 26 12:14:31.244189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 19/35] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:30 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1273 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:31.265578 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:31.272907 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:31.300732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:31.304281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:31.306127 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:31.309018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:31.310312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:31.311776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:31.692813 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:31.705940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a1fa294b-463a-447e-9242-e1411fd604d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1279 microversion: 2.1 time: 0.460127 Aug 26 12:14:31.717293 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 20/36] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:31 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1279 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:31.748849 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:31.749830 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:31.778466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:31.780957 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:31.781783 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:31.784684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:31.785405 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:31.788417 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:32.274377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:32.293049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-50049f87-8d3f-4337-8e37-b0636d674489 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1295 microversion: 2.1 time: 0.545891 Aug 26 12:14:32.297113 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 21/37] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:31 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1295 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:32.315538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:32.318119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:32.343346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:32.344313 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:32.346043 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:32.348153 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:32.349673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:32.351244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:32.994507 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:33.012579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5b881f27-7dfa-4db6-b17c-4db265e050bc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1273 microversion: 2.1 time: 0.708086 Aug 26 12:14:33.014912 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 22/38] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:32 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1273 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:33.031058 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:33.034278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:33.056874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:33.058564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:33.060149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:33.063806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:33.065704 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:33.066188 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:33.566316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:14:33.566823 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:14:33.567437 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:14:33.567949 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:14:33.568476 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:14:33.604143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:33.609030 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:33.612016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:33.618114 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:33.624818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:33.625390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:33.721067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:14:33.739746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:14:33.812407 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:14:33.815233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:14:33.854447 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:33.876061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dd9961e4-f611-4436-8be7-5ad068e6d19a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.856428 Aug 26 12:14:33.876687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 23/39] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:33 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:33.906100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:33.906716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:33.943049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:33.948625 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:33.949147 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:33.959303 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:33.960946 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:33.964302 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:33.969330 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a3763ae-fab6-42d4-850f-67a321adb027 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.924571 Aug 26 12:14:33.970670 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 17/40] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:14:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 4932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:14:33.984588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3730e85-0a7e-4735-ad7b-4d9bf663ffb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:33.985187 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3730e85-0a7e-4735-ad7b-4d9bf663ffb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:34.051239 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:34.899824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e3730e85-0a7e-4735-ad7b-4d9bf663ffb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:34.909182 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3730e85-0a7e-4735-ad7b-4d9bf663ffb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1242 microversion: 2.1 time: 0.928874 Aug 26 12:14:34.911936 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 18/41] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:33 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1242 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:34.913138 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:34.938331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9ef37279-0cee-4dd5-af47-84962f73d12c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1295 microversion: 2.1 time: 1.032721 Aug 26 12:14:34.940837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:34.941365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:34.943537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 24/42] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:33 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1295 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:34.964530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:34.967909 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:34.971155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:34.973008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:34.980373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:34.983866 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:34.986876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:34.990358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:35.006734 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:35.008640 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:35.011756 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:35.014876 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:35.018997 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:35.019736 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:35.464642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:35.479255 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-33360895-6052-432c-851e-e176bcea7109 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.528202 Aug 26 12:14:35.480801 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 25/43] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:34 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:35.704368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:35.728421 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-783d5362-9ea8-46bf-afd6-cddd770b738e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.815329 Aug 26 12:14:35.741647 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 19/44] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:34 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:35.933025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:35.933887 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:35.943496 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:35.946554 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:35.947259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:35.948566 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:35.948566 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:35.953524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:35.970524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:35.971246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:35.979328 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:35.982878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:35.983435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:35.984386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:35.987452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:35.988102 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.092765 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:36.102721 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-30a73f67-83d7-4857-8c5b-90d85b4aa29b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1246 microversion: 2.1 time: 0.174461 Aug 26 12:14:36.103686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 26/45] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:35 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1246 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:36.211254 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-91c5b6a7-40b1-4cc8-9656-b1927fae62e0 req-4295bcc2-1315-4012-a2d7-18ce65fc60c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dfffd0-58c9-4344-af80-b48af9048808", "tag": "85be8f03-a604-494a-b7b1-6edbd51be386"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:36.244217 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-91c5b6a7-40b1-4cc8-9656-b1927fae62e0 req-4295bcc2-1315-4012-a2d7-18ce65fc60c4 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:36.244754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-91c5b6a7-40b1-4cc8-9656-b1927fae62e0 req-4295bcc2-1315-4012-a2d7-18ce65fc60c4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:36.245279 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-91c5b6a7-40b1-4cc8-9656-b1927fae62e0 req-4295bcc2-1315-4012-a2d7-18ce65fc60c4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.285399 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-91c5b6a7-40b1-4cc8-9656-b1927fae62e0 req-4295bcc2-1315-4012-a2d7-18ce65fc60c4 service nova] Creating event network-changed:85be8f03-a604-494a-b7b1-6edbd51be386 for instance 48dfffd0-58c9-4344-af80-b48af9048808 on hv-cinder-84630 Aug 26 12:14:36.285894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-91c5b6a7-40b1-4cc8-9656-b1927fae62e0 req-4295bcc2-1315-4012-a2d7-18ce65fc60c4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 12:14:36.286471 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-91c5b6a7-40b1-4cc8-9656-b1927fae62e0 req-4295bcc2-1315-4012-a2d7-18ce65fc60c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 12:14:36.290135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:36.290833 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:36.291676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.295784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:36.296301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:36.296918 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.317347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.compute.rpcapi [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 12:14:36.331107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] Releasing lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 12:14:36.362535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9b9a7ea3-4280-4128-b5dc-1a6b5a767f63 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239703 Aug 26 12:14:36.363524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 27/46] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:36.391007 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:36.420171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-403259fc-a143-41a8-9cd2-47bc40e9bb0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.453923 Aug 26 12:14:36.421702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 20/47] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:35 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:36.504009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:36.505589 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:36.514470 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:36.514958 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:36.515429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.516323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:36.516770 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:36.517577 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.522864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=18 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:36.663302 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:36.671251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-95bd7e8e-4fdf-445d-ace5-01f1acb822d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.171730 Aug 26 12:14:36.684394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 28/48] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:36 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:36.749542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:36.750597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:36.757693 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:36.759886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:36.760411 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.761659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:36.762213 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:36.762719 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:36.909716 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:36.918685 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-395d5a85-85bf-466a-94a6-b021673f08d0 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.173081 Aug 26 12:14:36.919448 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 21/49] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:36 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:37.127962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:37.128665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:37.136921 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:37.139469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:37.140095 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:37.140954 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:37.141490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:37.141923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:37.273037 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:37.305710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-65c01966-5449-4989-8932-16d7b13308a4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1246 microversion: 2.1 time: 0.181098 Aug 26 12:14:37.306671 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 29/50] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:37 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1246 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:37.442213 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:37.442820 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:37.461133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:37.463595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:37.464149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:37.466288 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:37.466930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:37.469380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:37.697532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:37.698172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:37.709793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:37.713463 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:37.714173 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:37.715671 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:37.717777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:37.718796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:37.993816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:38.006253 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-040070a4-a1c9-4258-8563-322b36326157 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.567692 Aug 26 12:14:38.015996 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 22/51] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:37 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:38.025733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:38.033299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:38.074630 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:38.075746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:38.076416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:38.077755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:38.084779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:38.087770 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:38.125099 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:38.140312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-738c40cf-8e2f-4e53-b36b-b8cf4952ee73 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.450213 Aug 26 12:14:38.143739 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 30/52] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:37 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:38.329532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:38.330793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:38.354412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:38.358160 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:38.362115 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:38.370400 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:38.373096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:38.377012 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:38.452562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:38.551896 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:38.568448 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b00ac1f-c6a9-4fa4-9df6-2fadbf6d193b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.539587 Aug 26 12:14:38.579233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 23/53] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:38 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:38.583528 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-caa3bd29-931e-434a-807e-9318b823c2b5 req-be8cdf60-22a8-4d01-99a7-9d303d1885ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9578f0-4366-4a4f-859c-22dc57bbe34c", "tag": "84cd0865-63ff-4284-8278-850c455a4464"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:38.594578 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:38.604196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d2f51436-36c9-4bd1-b94e-a1af4cdf0c06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1246 microversion: 2.1 time: 0.280518 Aug 26 12:14:38.604794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 31/54] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:38 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1246 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:38.610882 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:38.617939 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-caa3bd29-931e-434a-807e-9318b823c2b5 req-be8cdf60-22a8-4d01-99a7-9d303d1885ac service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:38.620554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-caa3bd29-931e-434a-807e-9318b823c2b5 req-be8cdf60-22a8-4d01-99a7-9d303d1885ac service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:38.621553 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-caa3bd29-931e-434a-807e-9318b823c2b5 req-be8cdf60-22a8-4d01-99a7-9d303d1885ac service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:38.701584 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-caa3bd29-931e-434a-807e-9318b823c2b5 req-be8cdf60-22a8-4d01-99a7-9d303d1885ac service nova] Creating event network-changed:84cd0865-63ff-4284-8278-850c455a4464 for instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c on hv-cinder-84630 Aug 26 12:14:38.702644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-caa3bd29-931e-434a-807e-9318b823c2b5 req-be8cdf60-22a8-4d01-99a7-9d303d1885ac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 26 12:14:38.705353 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-caa3bd29-931e-434a-807e-9318b823c2b5 req-be8cdf60-22a8-4d01-99a7-9d303d1885ac service nova] Acquired lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 26 12:14:38.708412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:38.712793 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:38.717656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:38.718981 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:38.721392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:38.722737 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:38.770851 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.compute.rpcapi [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 26 12:14:38.774628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 26 12:14:38.809298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7ebcb83-3cf4-4b21-9e25-81274472d0a1 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235409 Aug 26 12:14:38.813907 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 24/55] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:39.044914 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:39.045703 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:39.068885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:39.072100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:39.077214 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:39.078109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:39.078599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:39.082985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:39.167136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:39.168018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:39.199072 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:39.201899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:39.204205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:39.208474 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:39.210338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:39.210801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:39.920870 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:39.928891 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-92905f79-4cc8-4fa5-9e39-c8d8449dafa0 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.892851 Aug 26 12:14:39.945404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 32/56] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:39 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:39.950838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:39.952746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:39.970358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:39.976304 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:39.977729 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:39.978532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:39.979002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:39.983810 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:40.075886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:40.084359 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c32d449a-08ed-4b67-a66c-99cb6d7a28ce tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.923449 Aug 26 12:14:40.089228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 25/57] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:39 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:40.098309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:40.104040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:40.116429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:40.124879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:40.126479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:40.127429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:40.130267 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:40.130881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:40.293790 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:40.303558 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-087c1fd5-71fc-42b0-89ff-24a5fa1b4319 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1294 microversion: 2.1 time: 0.213069 Aug 26 12:14:40.307292 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 26/58] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:40 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1294 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:40.375579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:40.393286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6b8d7e11-8fee-46b7-95b0-cdc82c6e7b47 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.446065 Aug 26 12:14:40.394057 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 33/59] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:39 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:40.952773 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:40.953382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:40.959996 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:40.987222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:40.990541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:40.991510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:40.997710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:40.998645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:41.113851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:41.114764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:41.129501 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:41.134364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:41.153972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:41.155502 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:41.160994 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:41.167139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:41.169875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:42.070854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:42.089075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c926bb27-318f-42fe-824c-1cba3aa8ce98 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 1.135552 Aug 26 12:14:42.089075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 27/60] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:40 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:42.091617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:42.092435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:42.100098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:42.100733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:42.103032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:42.103994 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:42.104945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:42.105563 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:42.133363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:42.142015 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6b58193a-28ce-46bd-897d-4039fc59d5bc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 1.031945 Aug 26 12:14:42.143610 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 34/61] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:41 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:42.159255 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:42.160261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:42.171479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:42.171977 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:42.172418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:42.173124 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:42.173578 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:42.175768 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:42.227174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:42.237698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3831c872-3cd7-4b88-b7fb-d79c30ea6c30 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1300 microversion: 2.1 time: 0.150905 Aug 26 12:14:42.240012 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 28/62] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:42 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1300 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:42.337332 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-12f33513-a183-4585-b57d-10b7ed7ba78d req-da632f74-2594-4094-a76a-49b57852069c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2f9bb13-4aeb-4ce4-a4df-039741278f3f", "tag": "60e04095-7475-413c-9ff2-bf277e248073"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:42.349542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12f33513-a183-4585-b57d-10b7ed7ba78d req-da632f74-2594-4094-a76a-49b57852069c service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:42.350578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12f33513-a183-4585-b57d-10b7ed7ba78d req-da632f74-2594-4094-a76a-49b57852069c service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:42.352378 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12f33513-a183-4585-b57d-10b7ed7ba78d req-da632f74-2594-4094-a76a-49b57852069c service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:42.379965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-12f33513-a183-4585-b57d-10b7ed7ba78d req-da632f74-2594-4094-a76a-49b57852069c service nova] Creating event network-changed:60e04095-7475-413c-9ff2-bf277e248073 for instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f on hv-cinder-84630 Aug 26 12:14:42.386116 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-12f33513-a183-4585-b57d-10b7ed7ba78d req-da632f74-2594-4094-a76a-49b57852069c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144382 Aug 26 12:14:42.387481 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 29/63] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:42.395033 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-61a521ef-45dc-4f82-94f9-021f1534f5ff req-343444d9-929e-4d14-9f4e-aebdb446771b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6221ce4-7d73-44fa-a573-5d3b3146b9d8", "tag": "4fd98237-b17a-4d7b-b281-7514f838bcf8"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:42.405976 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-61a521ef-45dc-4f82-94f9-021f1534f5ff req-343444d9-929e-4d14-9f4e-aebdb446771b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:42.406733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-61a521ef-45dc-4f82-94f9-021f1534f5ff req-343444d9-929e-4d14-9f4e-aebdb446771b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:42.407998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-61a521ef-45dc-4f82-94f9-021f1534f5ff req-343444d9-929e-4d14-9f4e-aebdb446771b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:42.422512 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-61a521ef-45dc-4f82-94f9-021f1534f5ff req-343444d9-929e-4d14-9f4e-aebdb446771b service nova] Creating event network-changed:4fd98237-b17a-4d7b-b281-7514f838bcf8 for instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 on hv-cinder-84630 Aug 26 12:14:42.428873 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-61a521ef-45dc-4f82-94f9-021f1534f5ff req-343444d9-929e-4d14-9f4e-aebdb446771b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039620 Aug 26 12:14:42.430640 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 30/64] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:42.514022 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:42.526436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fa25bd93-8994-4a31-a50c-a33e892feb22 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.380900 Aug 26 12:14:42.528028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 35/65] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:42 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:43.109116 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:43.109812 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:43.116638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.117806 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.118251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.119118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.119586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.120002 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.164628 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:43.165826 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:43.172793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.173611 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.174238 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.175169 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.175749 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.176463 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.463781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:43.468314 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:43.477617 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d15864c0-42e4-4460-9a11-511d0b12e1b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.317577 Aug 26 12:14:43.478938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 36/66] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:43 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:43.485314 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:43.486391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:43.493486 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.494286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.494533 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ce3de53-1b9e-426a-a32a-0e2849606fd2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.389559 Aug 26 12:14:43.495351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.495847 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 31/67] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:43 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:43.496558 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.497079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.497750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.564838 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:43.565746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:43.580971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.582295 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.584096 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.584870 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:43.586923 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:43.589415 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:43.756143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:43.765170 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d4fdbbe-89df-4b52-8dd7-41c280055ec1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.284925 Aug 26 12:14:43.766385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 37/68] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:43 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:43.822173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:43.831315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-634168db-d718-4a90-9b5b-af658277ce0a tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.271093 Aug 26 12:14:43.846216 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 32/69] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:43 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:44.499270 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:44.500569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:44.506675 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:44.507455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:44.508671 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:44.516106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:44.517444 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:44.522331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:44.523272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:44.525077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:44.525755 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:44.530910 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:44.531665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:44.532630 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:44.533263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:44.534151 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:44.542950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=83 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:44.907566 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=32 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:45.033360 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:45.041841 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11118d71-bca3-43b4-b393-ae2ff25f0534 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.529993 Aug 26 12:14:45.043460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 33/70] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:44 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:45.048396 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:45.049285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:45.056377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:45.059085 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:45.059621 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:45.060694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:45.061343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:45.062230 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:45.078145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:45.106461 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a4bb06cf-f175-4008-be86-aad60641b98a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.611025 Aug 26 12:14:45.115695 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 38/71] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:44 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:45.123469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:45.124096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:45.137994 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:45.138495 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:45.138936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:45.139688 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:45.140150 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:45.140638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:45.358580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:45.363738 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:45.368561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b45cf276-2f1a-4c44-9043-ac014311bafb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.323814 Aug 26 12:14:45.369805 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 34/72] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:45 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:45.372874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c4ce5647-e308-4efc-8bd8-d3a8db8ae82f tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.261238 Aug 26 12:14:45.373428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 39/73] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:45 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:45.374781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-12effca5-0081-4020-974a-9af97b1fbad1 req-6a833b09-31fb-46f2-9d45-f259532553a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92140aaa-db0d-49e1-9c47-c71a24aeeeec", "tag": "143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:45.385758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12effca5-0081-4020-974a-9af97b1fbad1 req-6a833b09-31fb-46f2-9d45-f259532553a3 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:45.386389 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12effca5-0081-4020-974a-9af97b1fbad1 req-6a833b09-31fb-46f2-9d45-f259532553a3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:45.386884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12effca5-0081-4020-974a-9af97b1fbad1 req-6a833b09-31fb-46f2-9d45-f259532553a3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:45.399348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-12effca5-0081-4020-974a-9af97b1fbad1 req-6a833b09-31fb-46f2-9d45-f259532553a3 service nova] Creating event network-changed:143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8 for instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec on hv-cinder-84630 Aug 26 12:14:45.405554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-12effca5-0081-4020-974a-9af97b1fbad1 req-6a833b09-31fb-46f2-9d45-f259532553a3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034509 Aug 26 12:14:45.406142 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 35/74] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:46.064140 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:46.064851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:46.072542 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.073030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.073474 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.074175 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.074633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.075061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.134507 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:46.135327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:46.145250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.145919 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.146631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.147939 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.148593 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.149236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.284179 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:46.296027 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b9390eb7-8802-498d-bd95-9316d4a8aa4c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.235930 Aug 26 12:14:46.297508 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 40/75] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:46 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:46.360040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:46.366052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-72842467-e4d6-4cd7-8ce8-48857545a4a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.238069 Aug 26 12:14:46.366734 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 36/76] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:46 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:46.391517 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:46.392176 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:46.397922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:46.398154 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:46.398973 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:46.399620 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.400253 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.400693 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.401384 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.401835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.402254 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.408040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.408618 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.410137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.411073 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:46.411665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:46.412216 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:46.610207 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:46.613705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:46.619674 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41a245b4-aee8-4aaf-839d-38a04b5d3197 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.226710 Aug 26 12:14:46.620302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 37/77] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:46 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:46.625988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c5d28866-4ddf-45bc-8512-b4420f6ed282 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.239902 Aug 26 12:14:46.626607 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 41/78] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:46 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:47.316635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:47.317523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:47.325666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.326831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.327665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.328831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.329537 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.330109 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.388651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:47.392027 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:47.400241 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.400960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.401553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.402408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.403390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.403991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.570818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:47.582542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6162d255-ef77-45f5-b316-17c5029a8b76 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.269450 Aug 26 12:14:47.583338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 38/79] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:47 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:47.626871 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:47.636488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-565b79fc-fd68-44f1-b9dc-1f08b1af7c9f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.252295 Aug 26 12:14:47.642036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:47.642853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:47.649721 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 42/80] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:47 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:47.655744 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.656314 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.656938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.657775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.658435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.659101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:47.659636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.660929 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:47.672079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.675384 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.675384 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.682972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:47.683614 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:47.684121 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:47.889692 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:47.901201 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:47.902850 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-933fdcf0-6dcf-410d-9ff7-3b0400994c1c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.251762 Aug 26 12:14:47.903663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 43/81] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:47 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:47.925413 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a8f0b47-5a06-4b71-9d33-bfa3cd76cc6b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.287436 Aug 26 12:14:47.926006 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 39/82] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:47 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:48.604294 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:48.604928 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:48.610756 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.611265 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.611701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:48.612414 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.612864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.613288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:48.669974 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:48.670614 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:48.676538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.677018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.677452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:48.678137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.678590 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.679012 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:48.739099 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:48.784919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:48.795499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0f7a5ad4-2c5b-4111-9e23-51f52bfbf3c3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.195436 Aug 26 12:14:48.796460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 44/83] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:48 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:48.842591 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:48.850191 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1707ef0a-eceb-4ac5-8497-d6d2509359e9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.184112 Aug 26 12:14:48.850752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 40/84] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:48 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:48.924267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:48.924870 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:48.931193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.931698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.932125 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:48.932802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.933259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.933701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:48.949460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:48.950203 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:48.956403 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.956980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.957489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:48.958368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:48.959468 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:48.959968 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:49.140839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:49.147643 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:49.149742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e7784664-05d7-4186-8d36-214cd604330e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.229313 Aug 26 12:14:49.155642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70b620cb-a9fa-459a-93a1-7630836603cc tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.212392 Aug 26 12:14:49.156208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 41/85] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:48 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:49.161688 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 45/86] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:48 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:49.817056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:49.817665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:49.824443 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:49.825169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:49.825603 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:49.826295 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:49.826747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:49.827176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:49.870612 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:49.871294 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:49.878264 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:49.878753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:49.879190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:49.879908 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:49.880356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:49.880927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:50.030509 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:50.046619 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-745294fd-cfe9-4988-b2cf-0f3b7cb3619f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.233318 Aug 26 12:14:50.047469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 42/87] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:49 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:50.066791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:50.075481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e59d7e9a-314c-41a3-aaa2-989e54c6423b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.209470 Aug 26 12:14:50.076002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 46/88] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:49 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:50.170440 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:50.171157 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:50.176909 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:50.177492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:50.177605 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:50.178094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:50.178728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:50.180081 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:50.180601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:50.181076 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:50.188074 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:50.188709 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:50.189343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:50.190167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:50.191233 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:50.191845 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:50.436544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:50.444086 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:50.446965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1dcdca3-fad6-4c81-9ba0-24e84628c1bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.279762 Aug 26 12:14:50.447694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 43/89] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:50 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:50.467065 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fc1dba82-db88-4939-8e8e-2f4a28017569 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.294063 Aug 26 12:14:50.468025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 47/90] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:50 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:51.069777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:51.071231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:51.077336 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.077900 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.078439 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.079184 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.079664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.080089 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.097642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:51.098707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:51.105244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.106283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.106921 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.107983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.108445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.108873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.113164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:51.294393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:51.301238 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:51.302292 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a92f89c-319a-4a83-81d0-7170f1f520ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.236349 Aug 26 12:14:51.302854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 44/91] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:51 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:51.311896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3b12ee2d-cf5a-4543-b524-97785e28aca0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.218801 Aug 26 12:14:51.312542 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 48/92] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:51 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:51.472072 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:51.472802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:51.479326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.479876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.480371 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.481171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.481682 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.482192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.488831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:51.489435 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:51.496472 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.497254 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.497699 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.499267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:51.499267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:51.499569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:51.687998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:51.691833 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:51.696808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c976f145-659e-4e9f-972b-80b385900d38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.229209 Aug 26 12:14:51.700423 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 45/93] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:51 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:51.701522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-920b51ee-aead-4bdf-b074-9d83febcacbb tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.216481 Aug 26 12:14:51.702077 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 49/94] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:51 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:52.323688 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:52.324455 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:52.330958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.331467 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.332059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.332466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:52.332891 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.333065 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:52.333209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.333837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.339799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.340285 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.340720 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.341404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.341906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.342329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.534201 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:52.545322 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:52.545577 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1451e0b-4725-4209-a009-ef3059f90837 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.225621 Aug 26 12:14:52.558424 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 46/95] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:52 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:52.564795 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c1b94326-10b6-4dca-a599-02bfe53c8580 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.235955 Aug 26 12:14:52.565568 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 50/96] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:52 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:52.717641 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:52.718331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:52.722084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:52.722771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:52.724645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.725263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.725803 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.726600 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.727390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.727883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.730892 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.731488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.732002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.732768 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:52.733232 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:52.733661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:52.930662 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:52.953531 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-239bdd31-1aa4-476b-81ff-c62720c73489 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.239921 Aug 26 12:14:52.954036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:52.963076 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5e52c2c2-164c-436c-aeed-23e6bcf9bda8 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.244929 Aug 26 12:14:52.963952 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 51/97] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:52 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:52.973735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 47/98] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:52 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:53.565751 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:53.566467 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:53.575316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:53.576166 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:53.577741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:53.581264 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:53.583795 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:53.584620 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:53.723439 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-510d2536-a1d6-4278-87f8-480ebb69f3dd req-0dad0c62-fc09-465a-ad04-461b216a4ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9578f0-4366-4a4f-859c-22dc57bbe34c", "name": "network-vif-plugged", "status": "completed", "tag": "84cd0865-63ff-4284-8278-850c455a4464"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:53.737576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-510d2536-a1d6-4278-87f8-480ebb69f3dd req-0dad0c62-fc09-465a-ad04-461b216a4ce1 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:53.738196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-510d2536-a1d6-4278-87f8-480ebb69f3dd req-0dad0c62-fc09-465a-ad04-461b216a4ce1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:53.740481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-510d2536-a1d6-4278-87f8-480ebb69f3dd req-0dad0c62-fc09-465a-ad04-461b216a4ce1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:53.781109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-510d2536-a1d6-4278-87f8-480ebb69f3dd req-0dad0c62-fc09-465a-ad04-461b216a4ce1 service nova] Creating event network-vif-plugged:84cd0865-63ff-4284-8278-850c455a4464 for instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c on hv-cinder-84630 Aug 26 12:14:53.792142 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-510d2536-a1d6-4278-87f8-480ebb69f3dd req-0dad0c62-fc09-465a-ad04-461b216a4ce1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250341 Aug 26 12:14:53.793053 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 52/99] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:53.808873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:53.811234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:53.823639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:53.824390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:53.825913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:53.827168 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:53.827838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:53.828593 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:53.973209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:53.984103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d482f8c-fbcf-48dc-ba39-6c9fc12b8d3b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.422298 Aug 26 12:14:53.984687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 48/100] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:53 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:53.997065 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:53.998005 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:54.006404 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:54.008082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:54.008858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:54.010168 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:54.010816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:54.011274 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:54.150795 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:54.159983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5f75ff9e-640b-460a-a341-7c25fe853583 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.365310 Aug 26 12:14:54.160563 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 53/101] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:53 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:54.166234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:54.167148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:54.174195 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:54.174919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:54.176159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:54.177569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:54.178159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:54.178862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:54.231862 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:54.243090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52026b46-44d5-4ac0-bd7c-5635a1ebbc3b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.251388 Aug 26 12:14:54.244469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 49/102] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:53 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:54.400973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:54.410122 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ee7c61a8-0d9e-4c47-bba0-234c6042f629 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.248385 Aug 26 12:14:54.412614 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 54/103] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:54 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:55.006993 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:55.007818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:55.016748 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.017762 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.018382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:55.020042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.024673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.025464 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:55.069575 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:14:55.183935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:55.184771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:55.196105 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.196970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.198413 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:55.205286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.207439 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.208381 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:55.698355 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:55.722858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd2247b8-7f7f-40ab-a047-dfbeb694ab64 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.717563 Aug 26 12:14:55.724370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 50/104] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:55 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:55.733885 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:55.735513 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:55.774338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.775388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.776382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:55.777427 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.778173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.779182 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:55.842848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:55.860961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c98b479b-852f-4363-8642-61e39727e204 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.682837 Aug 26 12:14:55.868767 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 55/105] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:55 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:55.874324 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:55.875337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:55.883545 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.885080 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.885740 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:55.886673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:55.887518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:55.888390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:56.260484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:56.270594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7774aed-5a7b-4769-a5bf-1e146af15e7a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.544793 Aug 26 12:14:56.271926 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 51/106] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:55 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:56.317677 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:56.329104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1a8e3c94-71d0-4211-9ab1-a037fc1b4309 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.458560 Aug 26 12:14:56.330395 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 56/107] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:55 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:56.749090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:56.750173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:56.758927 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:56.760978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:56.762081 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:56.765610 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:56.766239 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:56.766674 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:56.890781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:56.892278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:56.911691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:56.913101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:56.914959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:56.919361 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:56.919857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:56.920292 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:57.006670 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:57.017195 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9b9e0a5-e114-4b26-ba4f-6e0e81183fec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.276614 Aug 26 12:14:57.018313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 52/108] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:56 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:57.137548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:57.146701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b1e244cc-0d9d-4761-be7e-0f348c3a6b32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.261206 Aug 26 12:14:57.161043 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 57/109] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:56 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:57.303827 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:57.305410 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:57.320680 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:57.321865 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:57.322644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:57.327151 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:57.328272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:57.328720 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:57.355963 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:57.357850 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:57.366424 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:57.368111 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:57.368642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:57.371789 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:57.372528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:57.373172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:57.606329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:57.617807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0ff49d0-75e5-4c9c-8bd4-9aed3747f3c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.324219 Aug 26 12:14:57.622892 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 53/110] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:57 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:57.635243 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:57.647333 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b0cc37c8-11f7-45ce-9e6d-108ac5cb2893 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.295525 Aug 26 12:14:57.648720 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 58/111] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:57 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:14:57.684716 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-afc64070-ac04-43cf-a1fa-b28f7b1e770d req-90c56d16-22d7-4b2a-b4e8-1801e1fcd2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f9bb13-4aeb-4ce4-a4df-039741278f3f", "name": "network-vif-plugged", "status": "completed", "tag": "60e04095-7475-413c-9ff2-bf277e248073"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:57.698344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afc64070-ac04-43cf-a1fa-b28f7b1e770d req-90c56d16-22d7-4b2a-b4e8-1801e1fcd2d4 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:57.699709 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afc64070-ac04-43cf-a1fa-b28f7b1e770d req-90c56d16-22d7-4b2a-b4e8-1801e1fcd2d4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:57.700312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afc64070-ac04-43cf-a1fa-b28f7b1e770d req-90c56d16-22d7-4b2a-b4e8-1801e1fcd2d4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:57.716552 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-afc64070-ac04-43cf-a1fa-b28f7b1e770d req-90c56d16-22d7-4b2a-b4e8-1801e1fcd2d4 service nova] Creating event network-vif-plugged:60e04095-7475-413c-9ff2-bf277e248073 for instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f on hv-cinder-84630 Aug 26 12:14:57.725541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-afc64070-ac04-43cf-a1fa-b28f7b1e770d req-90c56d16-22d7-4b2a-b4e8-1801e1fcd2d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045660 Aug 26 12:14:57.726779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 54/112] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:14:58.037936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:58.038588 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:58.052012 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.052538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.052950 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.053659 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.054641 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.055340 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.170245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:58.171953 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:58.187901 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.189686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.191818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.192789 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.194481 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.195634 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.364147 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:58.378339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-05520c7b-25e3-4f6d-96b2-80ae0c26d327 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.344278 Aug 26 12:14:58.379874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 59/113] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:58 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:58.500861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:58.519251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6afe7333-7a6b-4ed0-89fc-04d3c232c49c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1321 microversion: 2.1 time: 0.353051 Aug 26 12:14:58.520406 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 55/114] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:58 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:58.645370 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:58.646242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:58.655320 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.656046 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.656896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.657766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.658521 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.659174 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.671007 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:58.672169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:58.682313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.683293 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.683731 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.684449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:58.686560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:58.686987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:58.939344 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:58.954382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-822861fc-1fb3-4a5a-8c7f-d9dce643e0b7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.313959 Aug 26 12:14:58.960969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 60/115] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:58 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:58.983107 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:58.993204 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83f8329d-f226-419a-95ed-9f9eb35684e3 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.327214 Aug 26 12:14:58.995879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 56/116] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:58 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:59.412691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:59.414841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:59.427484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:59.428448 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:59.429187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:59.430780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:59.431564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:59.432511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:59.542550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:59.543299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:59.549741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:59.550487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:59.551154 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:59.551985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:59.552542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:59.553832 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:59.706481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:59.715305 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-54347c76-5bc2-4e30-b6f1-e24f6e4b4b56 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.317595 Aug 26 12:14:59.716002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 61/117] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:59 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:59.736655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:14:59.744814 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cf1a0526-296d-4b99-9bed-545d3c2c5928 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1514 microversion: 2.1 time: 0.206801 Aug 26 12:14:59.745442 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 57/118] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:59 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:14:59.760894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8b1a3fbc-1f56-4c7c-b5c0-a2d9352e4b84 req-5a1e6535-46bc-4cc0-91d8-a3fe9281bccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dfffd0-58c9-4344-af80-b48af9048808", "name": "network-vif-plugged", "status": "completed", "tag": "85be8f03-a604-494a-b7b1-6edbd51be386"}, {"server_uuid": "c6221ce4-7d73-44fa-a573-5d3b3146b9d8", "name": "network-vif-plugged", "status": "completed", "tag": "4fd98237-b17a-4d7b-b281-7514f838bcf8"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:59.770691 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:14:59.774274 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8b1a3fbc-1f56-4c7c-b5c0-a2d9352e4b84 req-5a1e6535-46bc-4cc0-91d8-a3fe9281bccb service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:59.774814 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:59.774983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8b1a3fbc-1f56-4c7c-b5c0-a2d9352e4b84 req-5a1e6535-46bc-4cc0-91d8-a3fe9281bccb service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:59.775302 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8b1a3fbc-1f56-4c7c-b5c0-a2d9352e4b84 req-5a1e6535-46bc-4cc0-91d8-a3fe9281bccb service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:59.781755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:59.782425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:59.783072 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:59.783912 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:14:59.784487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:14:59.785017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:14:59.788111 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8b1a3fbc-1f56-4c7c-b5c0-a2d9352e4b84 req-5a1e6535-46bc-4cc0-91d8-a3fe9281bccb service nova] Creating event network-vif-plugged:85be8f03-a604-494a-b7b1-6edbd51be386 for instance 48dfffd0-58c9-4344-af80-b48af9048808 on hv-cinder-84630 Aug 26 12:14:59.788636 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8b1a3fbc-1f56-4c7c-b5c0-a2d9352e4b84 req-5a1e6535-46bc-4cc0-91d8-a3fe9281bccb service nova] Creating event network-vif-plugged:4fd98237-b17a-4d7b-b281-7514f838bcf8 for instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 on hv-cinder-84630 Aug 26 12:14:59.795268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8b1a3fbc-1f56-4c7c-b5c0-a2d9352e4b84 req-5a1e6535-46bc-4cc0-91d8-a3fe9281bccb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038621 Aug 26 12:14:59.795854 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 62/119] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:14:59.846920 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lazy-loading 'flavor' on Instance uuid 6a9578f0-4366-4a4f-859c-22dc57bbe34c {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:14:59.978001 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bac31ad0-07fe-4bab-a138-c26cc0a4214e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c/action" status: 200 len: 32 microversion: 2.1 time: 0.212831 Aug 26 12:14:59.978761 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 58/120] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:14:59 2022] POST /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:14:59.983874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:59.986267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:59.990334 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:14:59.991036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:14:59.999314 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.000093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.000494 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:00.001084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.001391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.001960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.002100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.002385 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:00.003926 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:00.006587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.007959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.012564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:00.307378 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:00.316401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a13663ea-eb2d-439a-9593-acf81e544bb2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.331199 Aug 26 12:15:00.316987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 59/121] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:59 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:00.322248 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:00.322860 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:00.328653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.329129 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.329566 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:00.330264 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.330836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.331353 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:00.337582 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:00.345898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ee751c18-9795-473b-9a69-b2644d0d1b5d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.370052 Aug 26 12:15:00.346453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 63/122] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:14:59 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:00.469306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:00.478161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c3fc02d-782e-44d6-b795-ee75b86a5f04 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.160156 Aug 26 12:15:00.482005 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 60/123] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:00 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:00.737330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:00.738089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:00.755404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.755968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.756401 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:00.762028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:00.762572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:00.762919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:01.078409 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:01.087116 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5bdb057b-2cf4-43b9-ad2c-5a1e723710f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.353700 Aug 26 12:15:01.087718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 64/124] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:00 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:01.337954 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:01.338570 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:01.353574 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:01.354071 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:01.354515 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:01.355245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:01.355690 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:01.356114 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:01.366364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:01.368156 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:01.374143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:01.374812 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:01.375524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:01.376490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:01.376949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:01.377596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:01.576637 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:01.581972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:01.593213 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-462d1b2c-fad7-4cea-8584-f9fc667c3f35 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.259404 Aug 26 12:15:01.593800 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 61/125] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:01 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:01.598459 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:01.599072 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:01.603704 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae89b0df-401c-4365-84f0-27bbc5c6e9ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.231456 Aug 26 12:15:01.604983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 65/126] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:01 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:01.607950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:01.608673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:01.609135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:01.609848 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:01.610328 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:01.610894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:01.766556 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:01.774631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f4e45c5b-6cdb-47a3-89ec-540b0058404b tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.179817 Aug 26 12:15:01.775397 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 62/127] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:01 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:02.107857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:02.108481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:02.114800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.115644 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.116264 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:02.117883 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.118462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.118933 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:02.123388 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:02.264114 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:02.272125 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0cf2e3e8-1bd9-466d-b5c3-c7b00c1f4f3e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.168077 Aug 26 12:15:02.273403 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 66/128] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:02 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:02.614706 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:02.615363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:02.622338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.622813 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.623259 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:02.623945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.624387 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.624854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:02.625354 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:02.625990 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:02.631933 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.632693 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.633216 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:02.633923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.634408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.634832 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:02.839021 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:02.840095 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:02.850323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-57ea2acc-8ce0-4e74-816b-df7d22bc6a4e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.228668 Aug 26 12:15:02.855586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ec2f93e-9d6b-4e0d-8dfe-db3ac55e40d8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.244470 Aug 26 12:15:02.856571 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 63/129] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:02 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:02.861132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:02.861966 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:02.863534 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 67/130] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:02 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:15:02.869325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.870012 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.870624 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:02.871611 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:02.872064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:02.872486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:03.014707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:03.024118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c089917-ce0f-4e68-ae3d-394bdb46580e tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1315 microversion: 2.1 time: 0.165717 Aug 26 12:15:03.024776 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 64/131] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:02 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:03.315669 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:03.320811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:03.348018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:03.349598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:03.352142 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:03.352978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:03.357148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:03.358649 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:03.590549 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:03.598815 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9f0e287f-477a-49d3-905f-38dd4b07145b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.305453 Aug 26 12:15:03.599667 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 68/132] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:03 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:03.872028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:03.872572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:03.877569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:03.878169 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:03.885980 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:03.886556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:03.887276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:03.887836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:03.888231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:03.888347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:03.888719 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:03.888818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:03.889272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:03.889536 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:03.889980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:03.890394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:04.123924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:04.133843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fadf2aa5-49af-4f92-94af-a4dd894d0a8e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.259925 Aug 26 12:15:04.135928 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 69/133] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:03 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:04.141959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:04.143790 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:04.154885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:04.155959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:04.156636 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:04.157656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:04.158957 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:04.159995 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:04.166878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:04.173324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:04.175767 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-644e3c0a-365b-4635-83be-4b06316946ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.307765 Aug 26 12:15:04.176322 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 65/134] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:03 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:04.305622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:04.314287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-50f27db9-8eb5-4a24-aa34-71bb146c8aed tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1501 microversion: 2.1 time: 0.176992 Aug 26 12:15:04.314969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 70/135] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:04 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:04.620693 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:04.621297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:04.637026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:04.637625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:04.638161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:04.638970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:04.639514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:04.644500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:04.921015 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:04.938004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91f1a34a-fdf5-44f9-91a6-642b39c4a989 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1361 microversion: 2.1 time: 0.321825 Aug 26 12:15:04.959108 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 66/136] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:04 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:05.157940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:05.159031 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:05.174421 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:05.175053 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:05.175443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:05.177243 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:05.177704 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:05.178128 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:05.200146 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:05.200869 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:05.211375 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:05.212331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:05.214102 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:05.216019 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:05.216898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:05.219156 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:05.499856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:05.503675 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:05.510007 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-76fd27e7-0e69-4e68-ae20-91f88e106b92 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.356324 Aug 26 12:15:05.512538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 71/137] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:05 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:05.531592 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23c95cd8-58a2-4fcf-ad6a-ec3562fc3b73 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.334812 Aug 26 12:15:05.532343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 67/138] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:05 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:05.702259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e4006ef2-44ab-493f-84bf-7ee1473b4adb req-c063582c-312d-41b2-8020-914a8fb17398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92140aaa-db0d-49e1-9c47-c71a24aeeeec", "name": "network-vif-plugged", "status": "completed", "tag": "143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:15:05.725356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e4006ef2-44ab-493f-84bf-7ee1473b4adb req-c063582c-312d-41b2-8020-914a8fb17398 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:05.726380 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e4006ef2-44ab-493f-84bf-7ee1473b4adb req-c063582c-312d-41b2-8020-914a8fb17398 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:05.727823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e4006ef2-44ab-493f-84bf-7ee1473b4adb req-c063582c-312d-41b2-8020-914a8fb17398 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:05.760736 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e4006ef2-44ab-493f-84bf-7ee1473b4adb req-c063582c-312d-41b2-8020-914a8fb17398 service nova] Creating event network-vif-plugged:143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8 for instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec on hv-cinder-84630 Aug 26 12:15:05.768255 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e4006ef2-44ab-493f-84bf-7ee1473b4adb req-c063582c-312d-41b2-8020-914a8fb17398 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072780 Aug 26 12:15:05.769553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 72/139] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:15:05.799777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5b34c13-929b-4a92-9026-82acdbda334b"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:15:05.802551 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:05.811922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:05.812813 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:05.813396 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:05.814493 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:05.815594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:05.816222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:05.982669 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:05.983615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:06.000143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.000815 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.001615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.002445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.004143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.004757 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.318314 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:06.346785 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-59531cb1-153f-4a58-ae15-c94ddd28e086 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1547 microversion: 2.1 time: 0.363680 Aug 26 12:15:06.349308 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 73/140] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:05 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1547 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:15:06.378816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:06.379673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:06.390189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.391609 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.392863 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.393586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.394051 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.394484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.500639 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31ab8c2d-07f2-4427-96f2-b3a9aa1c68aa tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "POST /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.704635 Aug 26 12:15:06.501885 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 68/141] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:15:05 2022] POST /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:15:06.535898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:06.537217 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:06.552200 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.552704 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.553134 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.554910 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.558486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.559126 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.687762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ad63550f-4ca6-4745-921d-5366d14d43ee tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.313942 Aug 26 12:15:06.688671 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 74/142] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:15:06 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-interface => generated 284 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:15:06.700922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:06.702220 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:06.715925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.720921 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.721824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.722723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:06.723185 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:06.723644 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:06.841598 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:06.859443 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b17a2ea-a9be-4949-a4f6-30e2b9dad4b5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.329562 Aug 26 12:15:06.861300 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 69/143] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:06 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:15:07.036278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:07.046360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-92a89586-4c88-4dd6-8225-080095e33b9c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.349119 Aug 26 12:15:07.060008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 75/144] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:06 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:07.883726 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:07.884484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:07.897196 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:07.899364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:07.901812 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:07.902817 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:07.903460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:07.904040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:08.068694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:08.070868 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:08.081757 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:08.083247 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:08.083895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:08.084873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:08.086383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:08.087020 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:08.324962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:08.338940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cf9fb3bd-6071-4054-a3bb-4b5afb0b84ea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1367 microversion: 2.1 time: 0.274926 Aug 26 12:15:08.352503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 76/145] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:08 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:08.370705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:08.386672 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-162fbc97-e6b4-410d-ae8b-d9e688356d85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.508468 Aug 26 12:15:08.387282 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 70/146] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:07 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:08.567002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-930f0491-be79-4e4e-b325-1382bdec7409 req-a6a42fd6-7bc5-4ea8-b854-32f39087113b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6221ce4-7d73-44fa-a573-5d3b3146b9d8", "tag": "4fd98237-b17a-4d7b-b281-7514f838bcf8"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:15:08.578033 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-930f0491-be79-4e4e-b325-1382bdec7409 req-a6a42fd6-7bc5-4ea8-b854-32f39087113b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:08.579191 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-930f0491-be79-4e4e-b325-1382bdec7409 req-a6a42fd6-7bc5-4ea8-b854-32f39087113b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:08.579875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-930f0491-be79-4e4e-b325-1382bdec7409 req-a6a42fd6-7bc5-4ea8-b854-32f39087113b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:08.599544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-930f0491-be79-4e4e-b325-1382bdec7409 req-a6a42fd6-7bc5-4ea8-b854-32f39087113b service nova] Creating event network-changed:4fd98237-b17a-4d7b-b281-7514f838bcf8 for instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 on hv-cinder-84630 Aug 26 12:15:08.607149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-930f0491-be79-4e4e-b325-1382bdec7409 req-a6a42fd6-7bc5-4ea8-b854-32f39087113b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044118 Aug 26 12:15:08.613538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 77/147] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:15:09.362442 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:09.363657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:09.369964 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:09.382285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:09.383137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:09.383806 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:09.384739 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:09.385261 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:09.385917 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:09.409834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:09.411234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:09.425179 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:09.425946 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:09.427032 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:09.430574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:09.431684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:09.432797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:09.873910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:09.887833 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-832c05c6-8d53-4c7e-8c0b-17d6aa7e2a5c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.482913 Aug 26 12:15:09.888426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 78/148] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:09 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:09.900580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:09.922702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3238c76e-37d2-45c3-86c4-f0a31a82c390 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1556 microversion: 2.1 time: 0.563063 Aug 26 12:15:09.923381 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 71/149] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:09 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1556 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:09.948713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:09.949210 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:09.964293 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:09.965110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:09.965710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:09.966579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:09.967456 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:09.971070 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:10.165197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5ea9489c-8007-494f-bafe-5b66c9d7d875 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221380 Aug 26 12:15:10.173744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 79/150] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:15:09 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-interface => generated 284 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:15:10.914597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:10.915222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:10.921919 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:10.922398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:10.925395 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:10.926120 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:10.930005 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:10.930708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:11.786697 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:11.805182 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8179c7e2-4953-4714-ba63-df94ade0c2b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.894898 Aug 26 12:15:11.822958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 72/151] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:10 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:12.479759 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-4f711214-5c61-43ea-bf66-d48abe4d3650 req-7324d702-2237-4139-ac6d-e5f7565e2df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92140aaa-db0d-49e1-9c47-c71a24aeeeec", "tag": "143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:15:12.488818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=92 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:12.492129 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4f711214-5c61-43ea-bf66-d48abe4d3650 req-7324d702-2237-4139-ac6d-e5f7565e2df6 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:12.493025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4f711214-5c61-43ea-bf66-d48abe4d3650 req-7324d702-2237-4139-ac6d-e5f7565e2df6 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:12.493654 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4f711214-5c61-43ea-bf66-d48abe4d3650 req-7324d702-2237-4139-ac6d-e5f7565e2df6 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:12.513667 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-4f711214-5c61-43ea-bf66-d48abe4d3650 req-7324d702-2237-4139-ac6d-e5f7565e2df6 service nova] Creating event network-changed:143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8 for instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec on hv-cinder-84630 Aug 26 12:15:12.521532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-4f711214-5c61-43ea-bf66-d48abe4d3650 req-7324d702-2237-4139-ac6d-e5f7565e2df6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047133 Aug 26 12:15:12.523428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 80/152] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:15:12.827487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:12.828404 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:12.840648 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:12.841153 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:12.841618 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:12.842484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:12.842918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:12.843437 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:12.995707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:13.004345 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ab2c8aa-ba77-4280-8380-be9a728366ab tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.180983 Aug 26 12:15:13.005557 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 73/153] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:12 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:14.026319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:14.027048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:14.033149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:14.033633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:14.034099 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:14.034796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:14.035273 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:14.035698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:14.183576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:14.200226 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0aa448c5-b800-482b-89d8-3a7bd7a8932c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.178068 Aug 26 12:15:14.200739 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 81/154] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:14 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:15.221844 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:15.223126 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:15.230460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:15.230941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:15.231584 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:15.232439 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:15.232888 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:15.233310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:15.379011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:15.389042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c81ec2d4-6898-400a-9bc8-8814445620e2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.170638 Aug 26 12:15:15.389906 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 74/155] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:15 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:16.409629 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:16.410239 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:16.416905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:16.417386 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:16.417826 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:16.418513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:16.418963 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:16.419418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:16.580962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:16.591413 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e624e03f-7826-48c7-a98b-ba34b7233986 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.185564 Aug 26 12:15:16.591981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 82/156] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:16 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:17.612999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:17.613602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:17.621425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:17.621899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:17.622329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:17.623263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:17.623715 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:17.624132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:17.762504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:17.775494 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-314c681c-4e91-4282-9dd7-5e5406c13882 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.166436 Aug 26 12:15:17.776074 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 75/157] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:17 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:18.699660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:18.700161 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:18.706058 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:18.706539 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:18.706973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:18.707682 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:18.708132 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:18.708557 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:18.734940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:15:18.797928 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:18.798536 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:18.807869 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:18.808632 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:18.808746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:18.809447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:18.810402 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:18.810941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:18.811644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:18.855477 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51fc8944-136d-4df1-b560-5882decfdfae tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 204 len: 0 microversion: 2.1 time: 0.159890 Aug 26 12:15:18.857985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 83/158] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:15:18 2022] DELETE /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:15:18.867548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:18.868445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:18.875988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:18.877077 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:18.877650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:18.878655 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:18.879455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:18.880029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:19.054666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:19.058307 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:19.062366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68b47746-329a-4a4c-b10f-a896f48ed17f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.268883 Aug 26 12:15:19.062938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 76/159] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:18 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:19.067613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dddf03f8-8dbe-4797-8d60-d2e5f92180f5 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1553 microversion: 2.1 time: 0.205836 Aug 26 12:15:19.068167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 84/160] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:18 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1553 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:20.084035 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:20.084723 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:20.089412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:20.089962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:20.092897 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:20.093390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:20.093830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:20.094539 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:20.094996 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:20.095584 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:20.098306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:20.098798 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:20.100747 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:20.104049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:20.104525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:20.105065 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:20.378661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:20.386545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1cf4cdbf-68cd-4272-b590-80376ab66026 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.306585 Aug 26 12:15:20.387447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 77/161] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:20 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:15:20.394097 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:20.403243 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-295849f2-a35d-4e0e-babc-fd9fcb95a14c tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1553 microversion: 2.1 time: 0.318245 Aug 26 12:15:20.404035 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 85/162] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:20 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1553 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:15:21.409958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:21.410563 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:21.433715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:21.434433 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:21.434589 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:21.434935 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:21.435406 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:21.436117 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:21.436567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:21.436986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:21.446338 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:21.462432 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:21.463190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:21.464148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:21.466534 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:21.468444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:21.883333 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:21.891185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9be438d7-9245-4ba4-a329-609693a607a9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.484995 Aug 26 12:15:21.894246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 78/163] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:21 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:21.920147 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:21.930552 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-afa856dd-0600-4ae1-9c0b-07fbd1a66e09 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1553 microversion: 2.1 time: 0.502209 Aug 26 12:15:21.931468 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 86/164] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:21 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1553 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:15:22.137542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-aff81173-996e-4b29-bb97-77708fac574e req-7e6e01db-d1b6-45d6-9805-67f8e312d5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2f9bb13-4aeb-4ce4-a4df-039741278f3f", "name": "network-vif-deleted", "tag": "60e04095-7475-413c-9ff2-bf277e248073"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:15:22.151773 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-aff81173-996e-4b29-bb97-77708fac574e req-7e6e01db-d1b6-45d6-9805-67f8e312d5f3 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:22.152265 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-aff81173-996e-4b29-bb97-77708fac574e req-7e6e01db-d1b6-45d6-9805-67f8e312d5f3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:22.152750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-aff81173-996e-4b29-bb97-77708fac574e req-7e6e01db-d1b6-45d6-9805-67f8e312d5f3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:22.167533 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-aff81173-996e-4b29-bb97-77708fac574e req-7e6e01db-d1b6-45d6-9805-67f8e312d5f3 service nova] Creating event network-vif-deleted:60e04095-7475-413c-9ff2-bf277e248073 for instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f on hv-cinder-84630 Aug 26 12:15:22.174654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-aff81173-996e-4b29-bb97-77708fac574e req-7e6e01db-d1b6-45d6-9805-67f8e312d5f3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041072 Aug 26 12:15:22.182117 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 79/165] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:15:22.918485 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:22.919069 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:22.925766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:22.926257 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:22.926676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:22.927609 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:22.928271 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:22.929634 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:22.956629 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:22.957364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:22.988798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:22.999376 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:23.001252 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:23.002068 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:23.002602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:23.005477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:23.090866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:23.101327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:23.101881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:23.102329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:23.105325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lazy-loading 'fault' on Instance uuid f2f9bb13-4aeb-4ce4-a4df-039741278f3f {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:15:23.108437 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5411ec3d-0af2-42db-a7f9-e79eb4743e49 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.193129 Aug 26 12:15:23.109198 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 87/166] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:22 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:23.186899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff96b716abcd4565866fc3c24cbe91e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e58ce6250ef341b6bdc369d9475f0670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:23.195636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1db29163-0509-4a2d-b279-fd9155d55628 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 200 len: 1351 microversion: 2.1 time: 0.245333 Aug 26 12:15:23.197280 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 80/167] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:22 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 1351 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:24.132362 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:24.133068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:24.142396 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:24.143090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:24.144469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:24.145646 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:24.146377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:24.147003 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:24.220518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:24.221012 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:24.230650 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:24.231143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:24.231606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:24.232305 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:24.232784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:24.233205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:24.248568 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] HTTP exception thrown: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Request method failure captured: Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f HTTP/1.1 Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkdPgAPkPMq_2uzBq8WumTkHhGXjkkdzaYeXcw8_v3aSXyeZcGjcfCPbQBw2mxYZn5cMWs452CYAHR7Pj1qxYH0aJ-sOD9sm1KbdR07rukfyiDZVb6Zu8fnye6YcRM2xFM7Mx4ZqP2aFgHHOQFB5YCDfI9A4hZVCwXwrwXWYn61v2w Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:15:24.253298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e58ce6250ef341b6bdc369d9475f0670", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: ff96b716abcd4565866fc3c24cbe91e5 Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.254572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'f2f9bb13-4aeb-4ce4-a4df-039741278f3f'} Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:15:24.255315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.256540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.258153 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Returning 404 to user: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:15:24.258153 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23df16e7-ca8e-4a88-af33-0008d287ca70 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 404 len: 111 microversion: 2.1 time: 0.039086 Aug 26 12:15:24.258153 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 81/168] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:24 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 12:15:24.334676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:24.343782 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f16194a0-1766-40c5-8b03-afd84fa7de20 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.217294 Aug 26 12:15:24.344896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 88/169] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:24 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:24.394750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:24.398735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:24.407349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:24.408489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:24.409794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:24.411474 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:24.412080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:24.413137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:24.420732 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:24.431220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] HTTP exception thrown: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Request method failure captured: Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f/os-volume_attachments HTTP/1.1 Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkdPgAPkPMq_2uzBq8WumTkHhGXjkkdzaYeXcw8_v3aSXyeZcGjcfCPbQBw2mxYZn5cMWs452CYAHR7Pj1qxYH0aJ-sOD9sm1KbdR07rukfyiDZVb6Zu8fnye6YcRM2xFM7Mx4ZqP2aFgHHOQFB5YCDfI9A4hZVCwXwrwXWYn61v2w Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:15:24.433056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e58ce6250ef341b6bdc369d9475f0670", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: ff96b716abcd4565866fc3c24cbe91e5 Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.434262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'server_id': 'f2f9bb13-4aeb-4ce4-a4df-039741278f3f'} Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:15:24.434965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:24.436209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:24.437299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Returning 404 to user: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:15:24.437299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b364fde-932f-4ebc-938b-3bd9e7800915 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044293 Aug 26 12:15:24.437299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 82/170] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:15:24 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:15:25.367367 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:25.369114 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:25.375682 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:25.376395 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:25.376922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:25.377925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:25.378287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:25.378807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:25.533848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:25.542657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-500046b7-456c-4e49-960c-a586e338511c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.180473 Aug 26 12:15:25.543339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 89/171] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:25 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:25.751638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:25.752720 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:25.763384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:25.764071 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:25.764583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:25.765524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:25.766191 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:25.766620 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:25.782143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] HTTP exception thrown: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Request method failure captured: Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f HTTP/1.1 Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkdPgAPkPMq_2uzBq8WumTkHhGXjkkdzaYeXcw8_v3aSXyeZcGjcfCPbQBw2mxYZn5cMWs452CYAHR7Pj1qxYH0aJ-sOD9sm1KbdR07rukfyiDZVb6Zu8fnye6YcRM2xFM7Mx4ZqP2aFgHHOQFB5YCDfI9A4hZVCwXwrwXWYn61v2w Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:15:25.784540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e58ce6250ef341b6bdc369d9475f0670", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: ff96b716abcd4565866fc3c24cbe91e5 Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.785713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'f2f9bb13-4aeb-4ce4-a4df-039741278f3f'} Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:15:25.786477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.791176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.792315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Returning 404 to user: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:15:25.792315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b63eb4f4-1716-40ec-9bd9-f04fdbe9eb86 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 404 len: 111 microversion: 2.1 time: 0.038414 Aug 26 12:15:25.792315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 83/172] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:15:25 2022] DELETE /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:15:25.800243 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:25.800940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] [instance: f2f9bb13-4aeb-4ce4-a4df-039741278f3f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:25.809875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:25.810701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:25.811043 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:25.812007 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:25.812663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:25.813235 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:25.830355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] HTTP exception thrown: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Request method failure captured: Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f HTTP/1.1 Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkdPgAPkPMq_2uzBq8WumTkHhGXjkkdzaYeXcw8_v3aSXyeZcGjcfCPbQBw2mxYZn5cMWs452CYAHR7Pj1qxYH0aJ-sOD9sm1KbdR07rukfyiDZVb6Zu8fnye6YcRM2xFM7Mx4ZqP2aFgHHOQFB5YCDfI9A4hZVCwXwrwXWYn61v2w Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:15:25.835708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e58ce6250ef341b6bdc369d9475f0670", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e58ce6250ef341b6bdc369d9475f0670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: e58ce6250ef341b6bdc369d9475f0670 Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-DeleteServersTestJSON-1737824709 Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: ff96b716abcd4565866fc3c24cbe91e5 Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-DeleteServersTestJSON-1737824709-project Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.837034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': 'f2f9bb13-4aeb-4ce4-a4df-039741278f3f'} Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:15:25.837685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. Aug 26 12:15:25.838750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:15:25.843985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] Returning 404 to user: Instance f2f9bb13-4aeb-4ce4-a4df-039741278f3f could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:15:25.843985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-94282ce5-8ad5-4cbb-9f14-077663caeb02 tempest-DeleteServersTestJSON-1737824709 tempest-DeleteServersTestJSON-1737824709-project] 10.222.0.61 "GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f" status: 404 len: 111 microversion: 2.1 time: 0.043055 Aug 26 12:15:25.843985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 90/173] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:25 2022] GET /compute/v2.1/servers/f2f9bb13-4aeb-4ce4-a4df-039741278f3f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:15:26.562905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:26.563466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:26.571193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:26.571719 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:26.572158 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:26.572857 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:26.573313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:26.573742 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:26.718170 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:26.728331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4e40c9a-2fa2-4dd4-a754-6981efda4e99 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.169416 Aug 26 12:15:26.728992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 84/174] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:26 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:27.762905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:27.763552 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:27.772346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:27.773019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:27.773686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:27.774885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:27.775547 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:27.776155 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:27.936651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:27.946279 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-baf0b313-8c73-4fba-90b7-1ceddb845456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.194289 Aug 26 12:15:27.947462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 91/175] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:27 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:28.972960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:28.973627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:28.991487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:28.993367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:28.995346 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:28.997090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:28.998024 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:28.998466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:29.534792 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:29.560333 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a357f55-83da-4705-9f69-0655d571aa23 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.592628 Aug 26 12:15:29.561081 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 85/176] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:28 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:30.587503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:30.588635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:30.598840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:30.599802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:30.601154 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:30.603359 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:30.604025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:30.604825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:30.908005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:30.919364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-63326a3d-03ba-4e23-b94f-dd07ddd857d5 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.339434 Aug 26 12:15:30.919961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 92/177] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:30 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:31.947190 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:31.950157 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:31.972565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:31.976829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:31.978505 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:31.983901 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:31.986418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:31.986599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:32.281421 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:32.294516 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3056992a-3878-49f4-89db-7562b69c75da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.357241 Aug 26 12:15:32.295106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 86/178] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:31 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:33.319841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:33.320481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:33.327014 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:33.327533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:33.327964 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:33.328663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:33.329108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:33.329528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:33.493838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:33.504392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8bf6c556-cf67-44cf-bee6-1b075d40ebb6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.189071 Aug 26 12:15:33.520808 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 93/179] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:33 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:15:34.531118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:34.532478 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:34.540004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:34.540688 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:34.541577 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:34.543042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:34.544430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:34.545164 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:34.778584 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:34.786187 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bece09bc-799d-4755-a853-ddd69deec227 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.263110 Aug 26 12:15:34.786747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 87/180] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:34 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:35.807036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:35.807688 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:35.816117 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:35.816784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:35.817218 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:35.819570 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:35.820066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:35.820493 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:36.010564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:36.018003 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e439356b-d5b9-457b-b594-80c7975e8791 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.214932 Aug 26 12:15:36.018666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 94/181] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:35 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:37.039309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:37.039919 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:37.045760 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:37.046239 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:37.046664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:37.047382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:37.047836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:37.048257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:37.196721 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:37.205628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2f82f18-fbac-43bf-ae5d-e3748ac11665 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.170855 Aug 26 12:15:37.206198 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 88/182] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:37 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:38.227103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:38.227773 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:38.234112 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:38.234600 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:38.235037 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:38.235772 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:38.236228 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:38.236653 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:38.375971 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:38.384078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4fdec694-03a0-4798-ad7d-f01006ec1afa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.161521 Aug 26 12:15:38.384661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 95/183] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:38 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:39.405906 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:39.407074 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:39.413698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=38 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:39.415687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:39.416343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:39.417108 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:39.417808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:39.418402 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:39.418960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:39.591759 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:39.614500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-557f8894-ac00-4355-949d-32a0b0a2d771 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.212324 Aug 26 12:15:39.617246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 89/184] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:39 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:40.636889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:40.637506 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:40.643809 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:40.644359 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:40.645323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:40.646415 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:40.647621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:40.648856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:40.959660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:40.967957 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-afb599fa-a926-4a0a-9d5c-8b98e26622c3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.335237 Aug 26 12:15:40.969151 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 96/185] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:40 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:41.988453 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:41.989003 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:41.996474 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:41.996963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:41.997398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:41.998277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:41.998907 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:41.999539 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:42.252139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:42.261371 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3bd7d845-802b-4901-9bac-33b1584ace3a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.276666 Aug 26 12:15:42.261839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 90/186] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:41 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:43.280881 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:43.282080 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:43.289781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:43.290509 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:43.291006 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:43.291898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:43.292788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:43.293370 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:43.507391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:43.515780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e8656e92-1189-4096-b02d-0fad39efd440 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.238653 Aug 26 12:15:43.516442 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 97/187] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:43 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:44.536855 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:44.537703 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:44.545377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:44.546051 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:44.546636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:44.547654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:44.548252 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:44.548816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:44.700736 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:44.710245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c4f8c31-8fa4-40ea-8500-9cd8b9210175 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.177224 Aug 26 12:15:44.711314 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 91/188] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:44 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:45.732132 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:45.733535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:45.736542 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:45.747431 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:45.747926 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:45.748355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:45.749067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:45.749511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:45.749925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:45.936448 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:45.945716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4154c925-e0bb-425e-a811-96577f0b2d6b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.217327 Aug 26 12:15:45.947100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 98/189] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:45 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:46.969837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:46.971460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:46.980260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:46.981174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:46.982032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:46.982958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:46.983652 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:46.984270 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:47.249681 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:47.258575 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4636e7bd-4aff-4bf8-a659-b83223c1c867 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.294481 Aug 26 12:15:47.282889 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 92/190] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:46 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:48.281141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:48.282497 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:48.290375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:48.291187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:48.291884 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:48.292596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:48.293100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:48.293763 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:48.467694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:48.480204 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fed27210-d87e-4d83-b5db-32270c319284 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.202600 Aug 26 12:15:48.482196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 99/191] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:48 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:48.813604 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9efddf8a-3c6a-44c5-9e16-664dcb6b29cd tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Action: 'create', calling method: .version_select at 0x7ffa97a06430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-904552570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLX1tWYFh1KEPTkalxuRgpnadZIhjbA6D3f485ttHhku19dkhyuxWAKDhxVP9llryosZJqQ1Y391I1g80P5qpLOS5BrvlFbqvbjOe2z2b8bJdK9ZFQDzk/9zJK4gLMDufg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:15:48.829912 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-9efddf8a-3c6a-44c5-9e16-664dcb6b29cd tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Getting quotas for project 293ca4bc65af4f25afb8456f32378173. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:15:48.834514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-9efddf8a-3c6a-44c5-9e16-664dcb6b29cd tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Getting quotas for user 2b51cd55973a419cad6311609395bb89 and project 293ca4bc65af4f25afb8456f32378173. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:15:48.861359 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9efddf8a-3c6a-44c5-9e16-664dcb6b29cd tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.269223 Aug 26 12:15:48.861959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 93/192] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:15:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:15:49.518042 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:49.519361 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:49.526062 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:49.526780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:49.527416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:49.528163 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:49.528622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:49.529049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:49.533125 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=93 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:15:49.676414 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:49.684888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96287fff-aa1a-43a2-9dda-7cf05b610250 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.172596 Aug 26 12:15:49.685452 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 100/193] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:49 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:50.707699 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:50.708226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:50.716724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:50.717200 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:50.717627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:50.718310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:50.718755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:50.719169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:50.848542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:50.857492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58973ecb-080b-45c9-9bb0-78f5c81e16fb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.153654 Aug 26 12:15:50.858128 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 94/194] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:50 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:51.882294 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:51.882984 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:51.891377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:51.892049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:51.892482 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:51.893235 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:51.893888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:51.894338 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:52.041470 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:52.049456 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-37eb0349-78b0-464e-96e9-e0c9d3e5ee71 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.173286 Aug 26 12:15:52.050023 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 101/195] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:51 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:53.071960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:53.072583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:53.079171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:53.079694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:53.080141 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:53.080816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:53.081268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:53.081690 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:53.217733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:53.228836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-56e01732-9c43-4e08-9fa0-606c7df6fc32 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.161597 Aug 26 12:15:53.229407 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 95/196] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:53 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:54.250048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:54.250576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:54.257306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:54.257782 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:54.258245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:54.258932 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:54.259418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:54.259899 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:54.396099 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:54.403752 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-efc91d84-14eb-4f11-92f1-144686e23dbe tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1520 microversion: 2.1 time: 0.157750 Aug 26 12:15:54.404318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 102/197] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:54 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:55.425436 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:55.425990 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:55.432947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:55.433432 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:55.433870 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:55.434554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:55.435008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:55.435459 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:55.571452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:55.579155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-502ef093-eb97-43fd-a792-ceae351b3385 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1500 microversion: 2.1 time: 0.157882 Aug 26 12:15:55.579886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 96/198] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:55 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:15:55.598707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:15:55.599417 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:15:55.605211 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:55.605689 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:55.606119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:55.606795 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:15:55.607261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:15:55.607679 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:15:55.746587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:15:55.754597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-846a2097-28b3-4fe0-adda-61f4f0f869f7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1515 microversion: 2.1 time: 0.159669 Aug 26 12:15:55.755165 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 103/199] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:15:55 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:00.303973 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:00.306957 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:00.309484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:00.316209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:00.316698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:00.317162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:00.317861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:00.318315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:00.318743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:00.322691 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=76 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:00.343634 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lazy-loading 'flavor' on Instance uuid 48dfffd0-58c9-4344-af80-b48af9048808 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:16:00.419272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f361a267-83f4-4ef0-b33f-8a7ddc0d8f40 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808/action" status: 200 len: 32 microversion: 2.1 time: 0.118769 Aug 26 12:16:00.424444 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 97/200] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:16:00 2022] POST /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:16:00.433259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:00.433865 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:00.440691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:00.441173 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:00.441601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:00.442291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:00.442735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:00.443151 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:00.576761 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:00.584441 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8ec525fb-602a-46ed-b2f4-d2e8e776fe0c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.156461 Aug 26 12:16:00.585011 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 104/201] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:00 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:01.606130 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:01.606829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:01.613666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:01.614150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:01.614605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:01.615316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:01.615770 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:01.616443 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:01.748597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:01.756479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0be6c551-2966-4cc0-806b-ac188379c602 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.154969 Aug 26 12:16:01.757491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 98/202] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:01 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:02.778558 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:02.779167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:02.785236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:02.785718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:02.786151 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:02.786838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:02.787320 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:02.787746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:02.917690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:02.925428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a9143204-4f29-4de5-91b6-31bb36e06b65 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.150913 Aug 26 12:16:02.925997 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 105/203] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:02 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:03.946169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:03.946707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:03.953203 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:03.953678 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:03.954108 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:03.954789 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:03.955260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:03.955681 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:04.083331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:04.091552 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76067641-ab55-4019-ba10-fec99dc6ca89 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.149563 Aug 26 12:16:04.092110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 99/204] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:03 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:05.111867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:05.112483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:05.119984 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:05.120483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:05.120890 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:05.121570 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:05.122016 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:05.122429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:05.254535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:05.262104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7d3673e5-2724-40f7-97fa-eaff070bb8fd tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.154079 Aug 26 12:16:05.262656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 106/205] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:05 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:06.283755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:06.284632 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:06.291193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:06.291853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:06.292433 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:06.293113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:06.293561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:06.293975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:06.425331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:06.434742 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52dcc49a-63ba-453a-adfa-1ba51d39c82f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.155567 Aug 26 12:16:06.435351 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 100/206] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:06 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:07.455781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:07.456339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:07.465603 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:07.466124 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:07.466555 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:07.467313 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:07.467759 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:07.468186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:07.605603 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:07.613922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b5458b12-258e-43ff-82bd-45d062405de1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.162009 Aug 26 12:16:07.614499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 107/207] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:07 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:08.636878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:08.637459 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:08.643877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:08.644348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:08.644779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:08.645451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:08.645896 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:08.646311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:08.780096 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:08.787938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2452073-5d65-4e51-900d-087a6e3b801f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.155471 Aug 26 12:16:08.788496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 101/208] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:08 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:09.809657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:09.810258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:09.816193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:09.816674 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:09.817107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:09.817789 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:09.818241 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:09.818661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:09.956512 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:09.965145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e019598a-7601-4fca-85d6-08942918a4db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.159457 Aug 26 12:16:09.965698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 108/209] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:09 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:10.986255 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:10.986704 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:10.997777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:10.997777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:10.997777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:10.997777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:10.998393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:10.998393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:10.998393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:11.132945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:11.140725 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a932941-7ea5-43c1-a1b0-5269af277a04 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.158560 Aug 26 12:16:11.141278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 102/210] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:10 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:12.161735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:12.162349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:12.169103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:12.169744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:12.170174 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:12.170888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:12.171380 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:12.171796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:12.305194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:12.313078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-52afc186-d9b2-4e94-a66b-48be6bf6b0f6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.155141 Aug 26 12:16:12.313650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 109/211] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:12 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:13.333782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:13.334405 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:13.340993 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:13.341473 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:13.341909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:13.342592 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:13.343043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:13.343496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:13.476136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:13.484549 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ab145ed-5451-4bbe-bb77-08d3dceb7413 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.154534 Aug 26 12:16:13.485139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 103/212] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:13 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:14.507073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:14.507716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:14.515829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:14.516266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:14.516888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:14.517605 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:14.518693 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:14.519129 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:14.655824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:14.663727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1d653e7e-6880-4c83-a90c-d841cbe7e9da tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.161665 Aug 26 12:16:14.664305 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 110/213] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:14 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:15.685221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:15.685829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:15.692396 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:15.692876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:15.693307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:15.693991 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:15.694438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:15.694859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:15.824773 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:15.832366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68e21160-2905-43af-a14b-14971346f59c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.150915 Aug 26 12:16:15.832935 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 104/214] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:15 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:16.853382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:16.853983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:16.856110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=26 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:16.863208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:16.863837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:16.865077 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:16.866318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:16.867473 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:16.868796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:17.010470 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:17.018205 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fc6c6555-a428-4078-b03a-23259cba3125 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.169138 Aug 26 12:16:17.018797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 111/215] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:16 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:18.042210 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:18.042904 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:18.049391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:18.050183 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:18.050898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:18.051931 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:18.052589 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:18.053218 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:18.196778 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:18.208830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4d15f94-d518-4a1f-8c15-d4ae201445d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.170319 Aug 26 12:16:18.209399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 105/216] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:18 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:19.231536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:19.232730 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:19.239733 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:19.240843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:19.241541 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:19.242222 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:19.243778 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:19.244205 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:19.427539 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:19.439148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-19ffa63f-fdb9-4d8b-9577-f5a21bd6057a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.212463 Aug 26 12:16:19.449499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 112/217] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:19 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:20.464664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:20.466058 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:20.473413 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:20.474097 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:20.474682 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:20.475583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:20.476194 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:20.476599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:20.642083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:20.649004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c5a3294-9f64-4e9a-9727-04fd82cb58df tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.189466 Aug 26 12:16:20.655289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 106/218] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:20 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:21.669719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:21.670324 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:21.676525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:21.677002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:21.677432 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:21.678117 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:21.678563 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:21.678979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:21.683490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=78 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:21.820591 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:21.829169 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3b1f7b14-f10c-402c-b97d-1953278ed58d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.163233 Aug 26 12:16:21.829800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 113/219] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:21 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:22.734697 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:22.735251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:22.743402 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:22.743903 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:22.744339 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:22.745044 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:22.745498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:22.745963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:22.778358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b470e542-e48a-4df2-a7f4-89275d0c5e0e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/ips" status: 200 len: 146 microversion: 2.1 time: 0.047292 Aug 26 12:16:22.781131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 107/220] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:16:22 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:22.852383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:22.853484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:22.861373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:22.861897 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:22.862411 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:22.863299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:22.863857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:22.864570 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:23.024968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:23.033404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-46a669ae-8f23-4b45-9e84-98d3c6daec54 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.187171 Aug 26 12:16:23.034451 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 114/221] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:22 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:24.054935 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:24.055782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:24.062091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:24.062602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:24.063037 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:24.063747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:24.064200 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:24.064624 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:24.248893 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:24.257065 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11cfc2e6-30ed-4818-93d9-69cf810babec tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.205761 Aug 26 12:16:24.257664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 108/222] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:24 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:24.478508 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1792302979", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-904552570", "security_groups": [{"name": "tempest-secgroup-smoke-593495162"}], "block_device_mapping_v2": [{"uuid": "26c9305e-458f-4fa1-ac6b-14618d0e528d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "37606d45-2ed8-4a10-aa47-f5052aa9b40a"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:24.643794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] validate_networks() for [('37606d45-2ed8-4a10-aa47-f5052aa9b40a', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:16:25.056905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:16:25.057425 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:16:25.057958 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:16:25.058589 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:16:25.059377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:16:25.076063 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:25.077377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:25.077969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:25.078875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:25.079526 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:25.080101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:25.103433 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Getting quotas for project 293ca4bc65af4f25afb8456f32378173. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:16:25.107773 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Getting quotas for user 2b51cd55973a419cad6311609395bb89 and project 293ca4bc65af4f25afb8456f32378173. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:16:25.168888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:16:25.170996 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='26c9305e-458f-4fa1-ac6b-14618d0e528d',volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:16:25.279595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:25.281500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:25.289687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:25.290555 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:25.291403 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:25.292355 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:25.293341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:25.293729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:25.369691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d33e87a0-1194-42dc-9900-050552b9bac9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.894589 Aug 26 12:16:25.376095 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 115/223] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:16:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:16:25.381190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-36ee8b5b-1600-4b77-ae33-499354259ea0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:25.391328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-36ee8b5b-1600-4b77-ae33-499354259ea0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:25.468190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-36ee8b5b-1600-4b77-ae33-499354259ea0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:25.483950 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-36ee8b5b-1600-4b77-ae33-499354259ea0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1094 microversion: 2.1 time: 0.105695 Aug 26 12:16:25.486319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 116/224] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:25 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1094 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:25.497550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:25.507694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-068f2700-1d4d-45a9-84a5-7184e76c25ba tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.233144 Aug 26 12:16:25.510760 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 109/225] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:25 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:26.505863 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:26.506467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:26.513204 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:26.513683 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:26.514112 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:26.520321 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:26.520815 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:26.521350 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:26.530309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:26.531146 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:26.537414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:26.537898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:26.538365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:26.539064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:26.539692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:26.540103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:26.587555 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:26.595882 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e59dca68-5946-4880-bf33-2717550b7ae5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1144 microversion: 2.1 time: 0.093774 Aug 26 12:16:26.596467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 117/226] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:26 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:26.682050 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:26.689930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aa0c6cb2-d578-42b5-bd03-77d1b7701b27 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.163419 Aug 26 12:16:26.690496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 110/227] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:26 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:27.624487 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:27.625196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:27.631343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:27.631828 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:27.632263 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:27.632948 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:27.633398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:27.633845 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:27.697589 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:27.706657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5170732c-ea55-4b5f-a66e-f92a19eb316a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1192 microversion: 2.1 time: 0.085823 Aug 26 12:16:27.707349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 118/228] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:27 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:27.710879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:27.711490 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:27.718062 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:27.718546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:27.718987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:27.719692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:27.720144 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:27.720567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:27.853289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c614b46-d5ee-4b51-ba9f-07c5aa2c64c8"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:27.856321 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:27.865026 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:27.865631 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:27.866339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:27.867041 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:27.867752 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:27.868177 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:27.888042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:27.896971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83a58869-c53b-4692-9535-b24e9b544577 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.190121 Aug 26 12:16:27.910405 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 111/229] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:27 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:28.106619 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-594161390", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:28.160389 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:16:28.443414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:16:28.443861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:16:28.444333 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:16:28.444740 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:16:28.445152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:16:28.454002 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.454477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.454911 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:28.455667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.456121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.456542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:28.463616 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:28.475653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Getting quotas for project 9ea0fdf820e748d0814b192a0c5bf572. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:16:28.481243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Getting quotas for user ab6a3226ae7f48838a87c7aafebc35e0 and project 9ea0fdf820e748d0814b192a0c5bf572. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:16:28.492285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:16:28.494648 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:16:28.538933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45631542-d3c9-4e7b-be1e-3e3fd0ff60eb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.437780 Aug 26 12:16:28.539655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 112/230] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:16:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 12:16:28.545156 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:28.545657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:28.552059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.552545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.553009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:28.553705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.554160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.554588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:28.579733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2aa52a9-5986-4412-9e56-aafeb75d663b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/ips" status: 200 len: 149 microversion: 2.1 time: 0.039029 Aug 26 12:16:28.586989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 113/231] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:16:28 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:28.586989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2dd05d9d-621b-4dfc-bc1c-3e1e05f50ad6 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:28.586989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2dd05d9d-621b-4dfc-bc1c-3e1e05f50ad6 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:28.639918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2dd05d9d-621b-4dfc-bc1c-3e1e05f50ad6 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:28.647170 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2dd05d9d-621b-4dfc-bc1c-3e1e05f50ad6 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1214 microversion: 2.1 time: 0.065789 Aug 26 12:16:28.648003 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 114/232] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:28 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:28.729052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:28.730297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:28.880276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.880945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.881594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:28.882558 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.883156 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.883868 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:28.954480 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:28.963569 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-927a53d3-a429-482f-8e58-01f3a5ec83b0 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1210 microversion: 2.1 time: 0.238672 Aug 26 12:16:28.964141 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 115/233] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:28 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1210 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:28.969341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:28.976302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:28.983307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.984765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.985479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:28.986569 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:28.987451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:28.988087 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:29.148869 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:29.161150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d95e7330-b0f4-4717-8037-c7542bf5447c tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.194706 Aug 26 12:16:29.161922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 116/234] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:28 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:29.425017 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9e3f2447-a9f1-43d2-a65e-cfdb9e4c165c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.575527 Aug 26 12:16:29.426629 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 119/235] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:16:27 2022] POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-volume_attachments => generated 194 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:29.669375 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:29.670128 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:29.676209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:29.676746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:29.677256 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:29.678022 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:29.678555 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:29.678981 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:29.749260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:29.757681 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09fde639-a406-43d2-8f08-e4ca8eb0d9af tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1266 microversion: 2.1 time: 0.092667 Aug 26 12:16:29.758307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 117/236] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:29 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:29.989558 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:29.991098 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:29.999985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.001225 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.002003 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.002927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.004013 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.004584 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.092596 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45f0938e-4c1f-4796-978a-0d5d05e1bf66"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:30.095222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:30.101313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.101798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.102224 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.104507 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.104507 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.105089 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.163021 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:30.174717 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9b077e67-c299-43c1-82d1-859e535cc4d4 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1277 microversion: 2.1 time: 0.191876 Aug 26 12:16:30.176794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 120/237] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:29 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:30.184659 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:30.185560 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:30.192455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.192983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.193427 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.194128 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.194788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.195480 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.336736 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:30.357853 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-284d1fc9-3dbd-4c01-becf-c94f039b9486 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.179399 Aug 26 12:16:30.362345 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 121/238] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:30 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:30.606627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f9b4abb7-8c5e-43e7-991f-3cbeaa24c0be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518205 Aug 26 12:16:30.607043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 118/239] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:16:30 2022] POST /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:30.706974 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-6d76e980-cec5-45bd-be39-676ee7ea4ffc req-05a8e5a2-8791-4313-a79d-07b5bb0602e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633ef7a8-d96f-41b4-a43d-786fe1283ac3", "tag": "f6c2f93f-5bf1-4f62-84fc-fd77626a13bf"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:30.722906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6d76e980-cec5-45bd-be39-676ee7ea4ffc req-05a8e5a2-8791-4313-a79d-07b5bb0602e6 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.723519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6d76e980-cec5-45bd-be39-676ee7ea4ffc req-05a8e5a2-8791-4313-a79d-07b5bb0602e6 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.724194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6d76e980-cec5-45bd-be39-676ee7ea4ffc req-05a8e5a2-8791-4313-a79d-07b5bb0602e6 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.735856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6d76e980-cec5-45bd-be39-676ee7ea4ffc req-05a8e5a2-8791-4313-a79d-07b5bb0602e6 service nova] Creating event network-changed:f6c2f93f-5bf1-4f62-84fc-fd77626a13bf for instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 on hv-cinder-84630 Aug 26 12:16:30.740550 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-6d76e980-cec5-45bd-be39-676ee7ea4ffc req-05a8e5a2-8791-4313-a79d-07b5bb0602e6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045753 Aug 26 12:16:30.741423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 122/240] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:30.778984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:30.779894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:30.786999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.787520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.787947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.788637 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:30.789160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:30.789581 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:30.854694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:30.862395 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41fa3d8a-cad5-4552-af48-26d03b063f74 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1266 microversion: 2.1 time: 0.088125 Aug 26 12:16:30.862949 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 119/241] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:30 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:31.210953 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:31.215331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:31.235834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.236246 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.236678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.237441 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.237898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.238381 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.384755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:31.385657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:31.389923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:31.393453 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.394154 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.394829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.397072 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.397619 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.398705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.399126 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c9f13613-71f1-4347-8a52-75419a972296 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.206591 Aug 26 12:16:31.411253 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 123/242] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:31 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:31.538992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:31.548151 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb40fe87-7764-403d-923e-3a2d8ec3083f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1501 microversion: 2.1 time: 0.168273 Aug 26 12:16:31.548927 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 120/243] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:31 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:31.570301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2a4469f-4d91-45d5-b258-043e521b2234"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:31.573676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:31.583796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.583796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.583796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.583796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.584143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.584143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.607072 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] HTTP exception thrown: Cannot 'attach_volume' instance 48dfffd0-58c9-4344-af80-b48af9048808 while it is in vm_state rescued Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Request method failure captured: Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808/os-volume_attachments HTTP/1.1 Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 74 Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkWNTQVOh-73fS3fVnMdoZwjJF4hSzPJugXKBzjT0CDmZY_79b-Stos2SO622p9EhnU1TyD3iAl7uru5C1Pm0w3rY4VqtDvxPc9Q-90zV55zke8UuNi33P0RSwSAcMEYglTjKX-6zNL-HS6Madg6ekec-OK3k7beuOCXJOBPHp7Nts Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:16:31.609288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/984b6ea268f04e8989283e6397b68370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_984b6ea268f04e8989283e6397b68370", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: a02508c20bd547708638c1875101da6f Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {"volumeAttachment": {"volumeId": "a2a4469f-4d91-45d5-b258-043e521b2234"}} Aug 26 12:16:31.610687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Cannot 'attach_volume' instance 48dfffd0-58c9-4344-af80-b48af9048808 while it is in vm_state rescued Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '48dfffd0-58c9-4344-af80-b48af9048808', 'body': {'volumeAttachment': {'volumeId': 'a2a4469f-4d91-45d5-b258-043e521b2234'}}} Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48dfffd0-58c9-4344-af80-b48af9048808 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:16:31.615457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48dfffd0-58c9-4344-af80-b48af9048808 while it is in vm_state rescued Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:16:31.616976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:16:31.618145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:16:31.618145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:16:31.618145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48dfffd0-58c9-4344-af80-b48af9048808 while it is in vm_state rescued Aug 26 12:16:31.618145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:16:31.618145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Returning 409 to user: Cannot 'attach_volume' instance 48dfffd0-58c9-4344-af80-b48af9048808 while it is in vm_state rescued {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:16:31.618145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f17ca6fb-3827-49e3-944e-2ef0e9c772b6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045496 Aug 26 12:16:31.618145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 124/244] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:16:31 2022] POST /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 12:16:31.620398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:31.620933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:31.627370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.627867 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.628306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.629008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.629466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.629898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.760538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20d64e52-7429-457b-830b-d55dd282446f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808/action" status: 202 len: 0 microversion: 2.1 time: 0.142926 Aug 26 12:16:31.762757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 121/245] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:16:31 2022] POST /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:16:31.771114 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:31.771914 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:31.781230 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.782210 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.782849 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.785699 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.786395 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.787049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.884936 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:31.886086 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:31.899578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.901633 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.903503 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:31.906161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:31.907179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:31.909380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:32.098313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:32.110363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c843bd8-4fc2-4081-b6b1-0c2046de5d83 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1284 microversion: 2.1 time: 0.230263 Aug 26 12:16:32.124360 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 122/246] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:31 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:32.130167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:32.139483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-94bdfd07-ceb3-46d6-bfeb-7ce342388282 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1509 microversion: 2.1 time: 0.372236 Aug 26 12:16:32.140840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 125/247] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:31 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:32.426822 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:32.427840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:32.444404 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:32.446228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:32.448992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:32.451301 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:32.453242 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:32.454392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:32.706868 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:32.715840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa0a2fde-6488-4bfa-9254-51f907d05179 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.293335 Aug 26 12:16:32.716693 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 123/248] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:32 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:33.132986 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:33.133728 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:33.153079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:33.154285 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:33.154888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:33.155826 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:33.162220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:33.163712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:33.168813 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:33.172279 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:33.172996 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:33.180406 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:33.180856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:33.186851 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:33.190575 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:33.195971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:33.273621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:33.281383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a71c5831-d2dd-4a62-9cd6-aa6b8ceabcdb tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1272 microversion: 2.1 time: 0.152352 Aug 26 12:16:33.283308 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 126/249] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:33 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:33.405206 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:33.412786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86b39687-3c54-47bd-ba23-94f498cbb75e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1509 microversion: 2.1 time: 0.254692 Aug 26 12:16:33.416428 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 124/250] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:33 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:33.738113 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:33.738730 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:33.748328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:33.749287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:33.750465 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:33.751463 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:33.752141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:33.752769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:33.945461 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:33.979332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-36956444-eb26-42ff-a0fe-dcb4844b7288 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.245657 Aug 26 12:16:33.980332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 127/251] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:33 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:34.304566 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:34.305171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:34.320160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:34.320991 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:34.321675 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:34.322812 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:34.323794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:34.324441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:34.435167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:34.436309 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:34.447867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:34.448390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:34.451965 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:34.453660 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:34.456139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:34.456754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:34.668229 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:34.692725 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b974057-6106-4bd5-95bd-2b594ddfc3d7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1314 microversion: 2.1 time: 0.392383 Aug 26 12:16:34.696011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 125/252] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:34 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:34.770596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:34.780231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-605c76a7-51bf-4774-9052-739f7c95d86a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1509 microversion: 2.1 time: 0.349816 Aug 26 12:16:34.795274 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 128/253] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:34 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1509 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:35.004647 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:35.028792 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-dd2a727c-ad7c-4848-8b6b-ca29558352df req-5f083acb-93af-427b-b1ec-f64b64aa5127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0965027c-c35c-4a66-85cf-558d9887d350", "tag": "e8a432f6-a2be-4acf-a2eb-20a24a64a99f"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:35.030380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:35.054028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:35.055741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:35.059235 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:35.060278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:35.061844 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-dd2a727c-ad7c-4848-8b6b-ca29558352df req-5f083acb-93af-427b-b1ec-f64b64aa5127 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:35.062568 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:35.063232 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:35.065062 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-dd2a727c-ad7c-4848-8b6b-ca29558352df req-5f083acb-93af-427b-b1ec-f64b64aa5127 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:35.065747 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-dd2a727c-ad7c-4848-8b6b-ca29558352df req-5f083acb-93af-427b-b1ec-f64b64aa5127 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:35.101419 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:35.110248 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-dd2a727c-ad7c-4848-8b6b-ca29558352df req-5f083acb-93af-427b-b1ec-f64b64aa5127 service nova] Creating event network-changed:e8a432f6-a2be-4acf-a2eb-20a24a64a99f for instance 0965027c-c35c-4a66-85cf-558d9887d350 on hv-cinder-84630 Aug 26 12:16:35.132041 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-dd2a727c-ad7c-4848-8b6b-ca29558352df req-5f083acb-93af-427b-b1ec-f64b64aa5127 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118251 Aug 26 12:16:35.135834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 129/254] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:16:35.408142 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:35.422627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e34a9bc-13f3-48e7-91a5-f0117afd99f8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.422221 Aug 26 12:16:35.424282 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 126/255] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:34 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:35.714633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=8 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:35.718980 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:35.719724 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:35.772099 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:35.772799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:35.773410 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:35.782276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:35.783869 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:35.784315 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:35.802844 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:35.803602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:35.809878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:35.810568 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:35.811176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:35.812222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:35.814597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:35.815032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:36.335741 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:36.344187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-86d88907-11cb-418c-a60c-13cfcd26b34e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1314 microversion: 2.1 time: 0.631546 Aug 26 12:16:36.344766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 130/256] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:35 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:36.389160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:36.397708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12df3373-3d31-4fee-be33-4be03be0459b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1515 microversion: 2.1 time: 0.599408 Aug 26 12:16:36.398689 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 127/257] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:35 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1515 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:36.450837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:36.451694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:36.457847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:36.458508 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:36.459108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:36.459856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:36.460310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:36.460765 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:36.746568 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:36.748823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:36.755394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c33aecc4-e392-4627-acd9-f0eedfbb009a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.313328 Aug 26 12:16:36.764597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 131/258] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:36 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:37.366037 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:37.366910 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:37.373823 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:37.374517 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:37.374948 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:37.375661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:37.376111 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:37.376526 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:37.396100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:37.566535 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:37.578785 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c7de7b8-ab55-4a1d-b580-7e8c894c8bb7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1314 microversion: 2.1 time: 0.216807 Aug 26 12:16:37.579657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 128/259] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:37 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:37.785104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:37.786580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:37.799157 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:37.800319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:37.801186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:37.802082 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:37.802716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:37.803726 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:37.856971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66984642-fd0f-4497-9ee4-331e88b62188 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'create', calling method: .version_select at 0x7ffa97a084c0>, body: {"keypair": {"name": "tempest-keypair-1544728634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK+5WK7PYsWohQa6kqQwwUHpseZZdwQKzri63n73du5KTHOjZj4wA4+sbDEdn7iqXOOzMPsDjiheGCQMIsayJ+75DEXNltQ26saOC0+53OxIEA4HrjUhfaRUNW6XMkPRg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:37.874343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-66984642-fd0f-4497-9ee4-331e88b62188 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for project 984b6ea268f04e8989283e6397b68370. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:16:37.878436 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-66984642-fd0f-4497-9ee4-331e88b62188 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for user a02508c20bd547708638c1875101da6f and project 984b6ea268f04e8989283e6397b68370. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:16:37.918393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66984642-fd0f-4497-9ee4-331e88b62188 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065196 Aug 26 12:16:37.928793 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 129/260] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:16:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:16:38.178604 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:38.204068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bd1e66be-263a-4646-bbab-bf2537553b7b tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.423979 Aug 26 12:16:38.211572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 132/261] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:37 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:38.540653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:38.546998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ad90244-6018-4fa0-9b36-9a5cc5b52a83 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:38.560475 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ad90244-6018-4fa0-9b36-9a5cc5b52a83 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:38.561146 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ad90244-6018-4fa0-9b36-9a5cc5b52a83 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:38.561893 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ad90244-6018-4fa0-9b36-9a5cc5b52a83 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:38.601394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:38.602493 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:38.629901 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:38.637509 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:38.638186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:38.639159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:38.639799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:38.640391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:38.676098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ad90244-6018-4fa0-9b36-9a5cc5b52a83 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Going to try to stop instance {{(pid=120698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 12:16:38.764533 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ad90244-6018-4fa0-9b36-9a5cc5b52a83 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action" status: 202 len: 0 microversion: 2.1 time: 0.222641 Aug 26 12:16:38.768558 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 130/262] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:16:38 2022] POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:16:38.828097 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:38.828874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:38.840819 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:38.841377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:38.842316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:38.843289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:38.843844 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:38.844277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:39.120658 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:39.147084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b83ab84f-e327-4abf-897f-7387646c4c9d tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1314 microversion: 2.1 time: 0.550078 Aug 26 12:16:39.148353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 133/263] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:38 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:39.206396 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:39.217283 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5785f90b-2800-4ef5-99be-7d077c4bc834 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.432518 Aug 26 12:16:39.231249 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 131/264] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:38 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:39.238440 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:39.238440 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:39.253124 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:39.254199 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:39.257110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:39.258135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:39.258993 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:39.260379 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:39.558257 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:39.567665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-26de1e74-4b21-418f-ab2c-7bd3db479330 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.339779 Aug 26 12:16:39.572526 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 134/265] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:39 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:40.171659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:40.173275 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:40.180594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:40.181762 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:40.182384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:40.183103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:40.183596 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:40.184189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:40.243137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:40.245484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:40.263781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:40.265852 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:40.266503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:40.268205 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:40.272520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:40.273109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:40.492694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:40.505519 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad026890-0ac9-44c9-a1de-56634571d1ea tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1314 microversion: 2.1 time: 0.340209 Aug 26 12:16:40.507700 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 132/266] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:40 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:40.529797 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-957654258", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b1347e6-c9cc-4abb-905a-84d42de7f611"}], "security_groups": [{"name": "tempest-securitygroup--773694097"}], "key_name": "tempest-keypair-1544728634", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:40.570924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:40.599545 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-54cbb804-ca8c-4fe3-b297-70b5435f4ad3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.361167 Aug 26 12:16:40.600740 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 135/267] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:40 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:40.619841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:40.620856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:40.647234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:40.648780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:40.649439 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:40.650433 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:40.652418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:40.653751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:40.712319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] validate_networks() for [('3b1347e6-c9cc-4abb-905a-84d42de7f611', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:16:40.927285 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:40.937461 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a18944e8-0b5b-4284-8fbe-3788e56a5598 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.334893 Aug 26 12:16:40.938061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 136/268] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:40 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:40.942915 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-10634575-d9de-43b2-bc82-b7b04d928190 req-95fde537-eac0-40c1-9163-9c12f2680b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0965027c-c35c-4a66-85cf-558d9887d350", "name": "network-vif-plugged", "status": "completed", "tag": "e8a432f6-a2be-4acf-a2eb-20a24a64a99f"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:40.956522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-10634575-d9de-43b2-bc82-b7b04d928190 req-95fde537-eac0-40c1-9163-9c12f2680b4b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:40.957259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-10634575-d9de-43b2-bc82-b7b04d928190 req-95fde537-eac0-40c1-9163-9c12f2680b4b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:40.958150 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-10634575-d9de-43b2-bc82-b7b04d928190 req-95fde537-eac0-40c1-9163-9c12f2680b4b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:40.975573 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-10634575-d9de-43b2-bc82-b7b04d928190 req-95fde537-eac0-40c1-9163-9c12f2680b4b service nova] Creating event network-vif-plugged:e8a432f6-a2be-4acf-a2eb-20a24a64a99f for instance 0965027c-c35c-4a66-85cf-558d9887d350 on hv-cinder-84630 Aug 26 12:16:40.982012 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-10634575-d9de-43b2-bc82-b7b04d928190 req-95fde537-eac0-40c1-9163-9c12f2680b4b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042582 Aug 26 12:16:40.985873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 137/269] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:41.069898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:41.353727 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:16:41.358428 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:16:41.359400 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:16:41.359969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:16:41.360373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:16:41.372738 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:41.374489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:41.375087 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:41.375999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:41.376629 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:41.377205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:41.401932 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for project 984b6ea268f04e8989283e6397b68370. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:16:41.406683 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Getting quotas for user a02508c20bd547708638c1875101da6f and project 984b6ea268f04e8989283e6397b68370. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:16:41.421078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:16:41.428392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:16:41.496669 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-166cc406-550a-4759-b638-030d10f5bf0a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.987118 Aug 26 12:16:41.497335 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 133/270] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:16:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:16:41.509684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-63ea63f1-551b-4886-ae6d-bca765679827 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:41.511104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-63ea63f1-551b-4886-ae6d-bca765679827 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:41.532385 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:41.533053 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:41.545147 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:41.560016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:41.560463 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:41.561202 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:41.561713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:41.562140 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:41.589670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-63ea63f1-551b-4886-ae6d-bca765679827 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:41.609160 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-63ea63f1-551b-4886-ae6d-bca765679827 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1245 microversion: 2.1 time: 0.104534 Aug 26 12:16:41.609676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 138/271] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:41 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:41.628656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:41.629564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:41.637299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:41.638341 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:41.638975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:41.639891 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:41.640351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:41.640775 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:41.949810 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:41.962773 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-518d88c6-de28-463d-9bca-2e61a4ee4ebf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.337996 Aug 26 12:16:41.964481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 139/272] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:41 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:41.970170 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:41.984228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b5ddba3c-2a09-4715-bd87-51575754bb89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1314 microversion: 2.1 time: 0.456037 Aug 26 12:16:41.996702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 134/273] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:41 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:42.002520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:42.005213 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:42.014891 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:42.015561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:42.016492 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:42.017321 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:42.017970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:42.019307 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:42.255911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:42.273977 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9ed8c5fa-a1b8-4a02-9f50-c88ec72149d9 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.307054 Aug 26 12:16:42.274597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 140/274] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:41 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:42.631979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:42.633257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:42.642782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:42.643546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:42.646094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:42.647114 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:42.647768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:42.648371 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:42.787458 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:42.801364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-292637eb-79c2-48dd-8796-3fe429beee8d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1241 microversion: 2.1 time: 0.174815 Aug 26 12:16:42.802524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 135/275] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:42 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1241 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:42.985224 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:42.986416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:42.993524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:42.994132 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:42.994718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:42.995875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:42.996445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:42.997063 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:43.008276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:43.009655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:43.020304 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:43.031109 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:43.031840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:43.032740 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:43.033363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:43.033973 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:43.261413 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:43.275475 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91bcd1c4-9bd1-49d1-9d84-775e4db90c21 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1314 microversion: 2.1 time: 0.270382 Aug 26 12:16:43.278005 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 136/276] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:43 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:43.300989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:43.302993 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:43.314411 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae9d4086-75e6-40af-b7e1-e437340ee660 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.333010 Aug 26 12:16:43.314922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:43.323909 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 141/277] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:42 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:43.333546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:43.334036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:43.334606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:43.335446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:43.336357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:43.336937 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:43.601822 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:43.613688 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f565ebe-bd21-4d97-8784-f4abb2600da5 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.318035 Aug 26 12:16:43.614285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 137/278] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:43 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:43.822245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:43.823008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:43.835785 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:43.836456 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:43.837037 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:43.837864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:43.838460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:43.840117 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:43.980450 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:43.992882 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-62431b88-2aeb-4b87-a088-309ea00ca446 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1297 microversion: 2.1 time: 0.174541 Aug 26 12:16:44.003681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 142/279] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:43 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1297 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:44.308170 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:44.310068 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:44.334089 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.334859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.335673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.336399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.336865 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.337746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:44.338365 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:44.338862 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.346528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.347022 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.350213 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.350957 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.363644 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.364577 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.680460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:44.692286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbdcd69b-583f-4660-9e68-e8390fb711b7 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1464 microversion: 2.1 time: 0.392883 Aug 26 12:16:44.694028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 138/280] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:44 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1464 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:44.721017 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:44.721841 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:44.722475 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:44.747676 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.750229 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.750370 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b98aaf13-f8b1-4c36-ab76-590be5b71d3c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.416303 Aug 26 12:16:44.751233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.752263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.752953 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.753621 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.753813 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 143/281] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:44 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:44.759412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:44.760656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:44.773410 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.774261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.775239 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.776310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.776954 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.777541 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.830971 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:16:44.953580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f165239e-1a5f-406f-989d-a0c9d72d7772 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 204 len: 0 microversion: 2.1 time: 0.198168 Aug 26 12:16:44.954645 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 144/282] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:16:44 2022] DELETE /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:16:44.964529 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:44.965608 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:44.972121 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.975662 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.976355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:44.977147 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:44.978349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:44.978835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:45.085947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:45.096764 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b1d58cc-6a8b-4cba-b354-c115e60f278e tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.384794 Aug 26 12:16:45.098913 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 139/283] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:44 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:45.107353 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:45.109446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:45.184468 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:45.185276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:45.186450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:45.187484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:45.188129 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:45.189432 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:45.330787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:45.332678 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:45.350426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0a247e17-3b72-4ef6-aa62-eb6215748bc2 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1470 microversion: 2.1 time: 0.390684 Aug 26 12:16:45.354702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26bacf6b-ee7f-40bc-a490-c8545877b525 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1305 microversion: 2.1 time: 0.254487 Aug 26 12:16:45.360870 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 140/284] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:45 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1305 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:45.371391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 145/285] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:44 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1470 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:45.748368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ed39c64c-f00e-43bc-8fd3-d93a2f23f3bf req-87088a3d-8248-4a2b-a422-cc306337f419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633ef7a8-d96f-41b4-a43d-786fe1283ac3", "name": "network-vif-plugged", "status": "completed", "tag": "f6c2f93f-5bf1-4f62-84fc-fd77626a13bf"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:45.764027 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed39c64c-f00e-43bc-8fd3-d93a2f23f3bf req-87088a3d-8248-4a2b-a422-cc306337f419 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:45.765470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed39c64c-f00e-43bc-8fd3-d93a2f23f3bf req-87088a3d-8248-4a2b-a422-cc306337f419 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:45.765702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed39c64c-f00e-43bc-8fd3-d93a2f23f3bf req-87088a3d-8248-4a2b-a422-cc306337f419 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:45.779089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:45.779853 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:45.787151 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:45.788081 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:45.788857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:45.792067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:45.792703 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:45.793764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:45.799489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ed39c64c-f00e-43bc-8fd3-d93a2f23f3bf req-87088a3d-8248-4a2b-a422-cc306337f419 service nova] Creating event network-vif-plugged:f6c2f93f-5bf1-4f62-84fc-fd77626a13bf for instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 on hv-cinder-84630 Aug 26 12:16:45.806408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ed39c64c-f00e-43bc-8fd3-d93a2f23f3bf req-87088a3d-8248-4a2b-a422-cc306337f419 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067466 Aug 26 12:16:45.807543 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 141/286] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:46.025960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:46.035453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-afdec33e-258e-470b-97b2-44ccdc6f54cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.262232 Aug 26 12:16:46.041305 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 146/287] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:45 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:46.125482 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:46.126603 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:46.139192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:46.143565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:46.144179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:46.146519 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:46.149288 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:46.150485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:46.381349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:46.383531 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:46.391340 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:46.391832 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:46.392806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:46.393674 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:46.394333 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:46.394750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:46.420417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:46.433043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05239ffd-594f-4e23-84f7-b26e8e3d14ed tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.311524 Aug 26 12:16:46.433977 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 142/288] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:46 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:46.439990 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:46.440898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:46.449313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:46.450105 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:46.450606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:46.451418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:46.451857 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:46.452704 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:46.585405 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:46.597109 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-941becb7-74cb-43d8-9092-5c80fdf2a0c8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1305 microversion: 2.1 time: 0.161853 Aug 26 12:16:46.619747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 143/289] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:46 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:46.837923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:46.847351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7b3ceee7-d536-4c92-b160-ac7b5e8083ab tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1470 microversion: 2.1 time: 0.469655 Aug 26 12:16:46.865001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 147/290] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:46 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1470 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:47.058045 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:47.058930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:47.066485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.066981 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.075608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.076487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.076975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.077410 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.285508 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:47.296392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9469094-17b6-4141-be1a-5a894bac747f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.242284 Aug 26 12:16:47.296989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 144/291] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:47 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:47.381943 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9ffcf8f6-a1d2-481d-a4b3-0a4d1ba5550f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: .version_select at 0x7ffa979a1820>, body: {"keypair": {"name": "tempest-keypair-1570421095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfzgUCn68om4l60CPjZ6nvLZlvo/DOkcpCa8WMEspULmptMS4XDD00h+5f4E8vL/9Gr0DifzUKWPa+EXxBKSPZy65vskpL+KBeY405f2SrQoeP5+H/nwgAUFF5+rfoww=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:47.389520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:47.404959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9ffcf8f6-a1d2-481d-a4b3-0a4d1ba5550f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:16:47.409144 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9ffcf8f6-a1d2-481d-a4b3-0a4d1ba5550f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:16:47.459364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:47.460064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:47.466155 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9ffcf8f6-a1d2-481d-a4b3-0a4d1ba5550f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090117 Aug 26 12:16:47.471544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.472346 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.473036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.473950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.474626 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.475746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.486290 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 148/292] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:16:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:47.620336 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:47.621355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:47.628319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.630496 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.631266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.632181 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.632992 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.633622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.737789 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:47.872483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:47.881900 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a147669-3b17-4e66-b004-98c2131c49d8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.429783 Aug 26 12:16:47.882492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 145/293] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:47 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:47.890462 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:47.894589 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:47.903981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4e293598-75cc-423b-98c0-9989e4d96135 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1303 microversion: 2.1 time: 0.289739 Aug 26 12:16:47.922861 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 149/294] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:47 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:47.923074 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:47.925554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.926045 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.926483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.927188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:47.927729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:47.928154 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:47.956284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:48.138049 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:48.150729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-127ff8b0-2b9a-486c-8766-fe72a6199b89 tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1470 microversion: 2.1 time: 0.261184 Aug 26 12:16:48.168744 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 146/295] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:47 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:48.268479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-c6c7a919-29d2-4165-8b7f-c4724087c6a5 req-8808bf9e-8b22-4b88-8e72-bdf9b50fb558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0965027c-c35c-4a66-85cf-558d9887d350", "name": "network-vif-deleted", "tag": "e8a432f6-a2be-4acf-a2eb-20a24a64a99f"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:48.297011 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6c7a919-29d2-4165-8b7f-c4724087c6a5 req-8808bf9e-8b22-4b88-8e72-bdf9b50fb558 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:48.297515 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6c7a919-29d2-4165-8b7f-c4724087c6a5 req-8808bf9e-8b22-4b88-8e72-bdf9b50fb558 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:48.298131 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6c7a919-29d2-4165-8b7f-c4724087c6a5 req-8808bf9e-8b22-4b88-8e72-bdf9b50fb558 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:48.318948 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c6c7a919-29d2-4165-8b7f-c4724087c6a5 req-8808bf9e-8b22-4b88-8e72-bdf9b50fb558 service nova] Creating event network-vif-deleted:e8a432f6-a2be-4acf-a2eb-20a24a64a99f for instance 0965027c-c35c-4a66-85cf-558d9887d350 on hv-cinder-84630 Aug 26 12:16:48.323998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:48.325470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:48.330670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-c6c7a919-29d2-4165-8b7f-c4724087c6a5 req-8808bf9e-8b22-4b88-8e72-bdf9b50fb558 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069404 Aug 26 12:16:48.331722 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 150/296] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:48.337567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:48.338077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:48.338516 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:48.342862 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:48.345226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:48.347233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:48.759752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:48.791446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3130694-2eb0-484f-b53b-eb5f22c528cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.465129 Aug 26 12:16:48.793327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 147/297] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:48 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:48.910457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:48.912487 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:48.940081 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:48.940643 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:48.943131 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:48.945281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:48.947858 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:48.953473 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:48.955860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:48.957684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:48.961676 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:48.964808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:48.967399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:48.970150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:48.973608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:48.976088 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:49.333852 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:49.342853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b2aa8b5-aef7-4ee9-b4fd-c296a77fc45d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.407476 Aug 26 12:16:49.344846 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 148/298] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:48 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:49.349659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:49.357265 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:49.366784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-24fde38c-cdc9-475b-90e4-ff616ed04aaa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1265 microversion: 2.1 time: 0.462147 Aug 26 12:16:49.367925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:49.368772 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 151/299] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:48 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1265 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:49.384300 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:49.387295 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:49.387890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:49.391027 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:49.391653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:49.394705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:49.462383 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:49.463885 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:49.464608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:49.465271 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lazy-loading 'fault' on Instance uuid 0965027c-c35c-4a66-85cf-558d9887d350 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:16:49.548228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab6a3226ae7f48838a87c7aafebc35e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea0fdf820e748d0814b192a0c5bf572', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:49.559042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a5d9fb96-fa85-479d-9f2f-5069059f500e tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 200 len: 1304 microversion: 2.1 time: 0.212981 Aug 26 12:16:49.561853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 149/300] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:49 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:49.813341 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:49.814249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:49.823296 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:49.824159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:49.825364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:49.826621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:49.827290 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:49.830113 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.168972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:50.181636 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0ac76c33-b2f1-43ce-9019-39b7293f4ac3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.372309 Aug 26 12:16:50.182676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 152/301] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:49 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:50.364882 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:50.370187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:50.370473 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c7500598-0801-4bec-bb13-6193d749e40e req-6b6f19c3-c859-4b0c-89a6-29ab8c4413e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5a14c-01ca-4ad0-94f0-cc7edcd90c48", "tag": "2265e6e6-c3fa-4e50-bd81-1d0302423d65"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:50.396889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.400816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.401522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.402466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.405284 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.405938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.407398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7500598-0801-4bec-bb13-6193d749e40e req-6b6f19c3-c859-4b0c-89a6-29ab8c4413e1 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.410576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7500598-0801-4bec-bb13-6193d749e40e req-6b6f19c3-c859-4b0c-89a6-29ab8c4413e1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.411265 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7500598-0801-4bec-bb13-6193d749e40e req-6b6f19c3-c859-4b0c-89a6-29ab8c4413e1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.431541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c7500598-0801-4bec-bb13-6193d749e40e req-6b6f19c3-c859-4b0c-89a6-29ab8c4413e1 service nova] Creating event network-changed:2265e6e6-c3fa-4e50-bd81-1d0302423d65 for instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 on hv-cinder-84630 Aug 26 12:16:50.437569 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c7500598-0801-4bec-bb13-6193d749e40e req-6b6f19c3-c859-4b0c-89a6-29ab8c4413e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086303 Aug 26 12:16:50.445811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 150/302] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:50.460219 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:50.464308 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:50.471898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.472689 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.473486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.474382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.475269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.475887 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.670746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:50.682799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3003aba1-bfe4-43b6-801b-5f8353edbea8 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1452 microversion: 2.1 time: 0.234212 Aug 26 12:16:50.686148 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 151/303] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:50 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1452 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:50.692031 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:50.693430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] [instance: 0965027c-c35c-4a66-85cf-558d9887d350] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:50.716884 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:50.726561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f87c9c48-70dd-4902-9d39-39f24408df13 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.365819 Aug 26 12:16:50.730863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.731503 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.748445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.748895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 153/304] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:50 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:50.754599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.755094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.755525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.766962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:50.767615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:50.791135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.791666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.792104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.792818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:50.793268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:50.793687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:50.800929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] HTTP exception thrown: Instance 0965027c-c35c-4a66-85cf-558d9887d350 could not be found. Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Request method failure captured: Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 HTTP/1.1 Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLmZ8ag1asPAbR5ykb2UeiIUPLSwlh1Df7NK9hBbaOLxIWVjz6dEDw9iPopgYYeDsca3hOtFXTDdOb2J2gwPV5uexLlmJBv3LklWS3LLGeHSpViOaaePi2wwcFa4BTDHoD0kYfJQOZxmT-b00ef26ebjZ_U97J0LYA1NJvn7CKuA1SQ Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9ea0fdf820e748d0814b192a0c5bf572 Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1454540266 Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:16:50.802576 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9ea0fdf820e748d0814b192a0c5bf572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9ea0fdf820e748d0814b192a0c5bf572", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9ea0fdf820e748d0814b192a0c5bf572"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9ea0fdf820e748d0814b192a0c5bf572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1454540266 Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9ea0fdf820e748d0814b192a0c5bf572 Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1454540266 Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1454540266-project Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: ab6a3226ae7f48838a87c7aafebc35e0 Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1454540266-project Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 0965027c-c35c-4a66-85cf-558d9887d350 could not be found. Aug 26 12:16:50.803929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '0965027c-c35c-4a66-85cf-558d9887d350'} Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0965027c-c35c-4a66-85cf-558d9887d350 could not be found. Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:16:50.804711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0965027c-c35c-4a66-85cf-558d9887d350 could not be found. Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0965027c-c35c-4a66-85cf-558d9887d350 could not be found. Aug 26 12:16:50.805980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:16:50.808132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] Returning 404 to user: Instance 0965027c-c35c-4a66-85cf-558d9887d350 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:16:50.808132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-00e92051-0d74-4ffc-a6a5-1f4dd1f588da tempest-VolumesNegativeTest-1454540266 tempest-VolumesNegativeTest-1454540266-project] 10.222.0.61 "GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350" status: 404 len: 111 microversion: 2.1 time: 0.116505 Aug 26 12:16:50.808132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 152/305] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:50 2022] GET /compute/v2.1/servers/0965027c-c35c-4a66-85cf-558d9887d350 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:16:51.097640 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:51.116014 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-061a2972-e23d-41c8-a233-30734b73de7c tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1452 microversion: 2.1 time: 0.363525 Aug 26 12:16:51.117878 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 154/306] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:50 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1452 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:51.208009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:51.208654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:51.226119 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:51.228862 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:51.229495 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:51.230580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:51.231243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:51.231888 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:51.387770 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:51.416348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=18 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:51.534986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:51.551642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e0c8b08-a367-41b2-b316-ba6614d789c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.347476 Aug 26 12:16:51.552230 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 153/307] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:51 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:51.687528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-889477699", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7e62f88-9652-4f52-9fec-a02b6bfed4c3"}], "security_groups": [{"name": "tempest-securitygroup--166275326"}], "key_name": "tempest-keypair-1570421095", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:51.780137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:51.781721 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:51.789986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:51.791067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:51.791694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:51.796583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:51.799047 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:51.800043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:52.086237 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:52.098074 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad9a8fd3-c26c-432e-aa49-6191cd9ae06b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.347628 Aug 26 12:16:52.101849 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 154/308] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:51 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:52.178585 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] validate_networks() for [('c7e62f88-9652-4f52-9fec-a02b6bfed4c3', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:16:52.576884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:52.577479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:52.599644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:52.603368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:52.603903 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:52.604658 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:52.605379 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:52.606258 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:53.085268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:16:53.086393 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:16:53.087787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:16:53.093014 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:16:53.093795 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:16:53.114719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:53.118167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:53.119898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:53.124692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:53.134819 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:53.136768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c68377f7-fde6-4cc2-af36-09f90177c7af tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.563760 Aug 26 12:16:53.137448 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:53.138251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:53.142282 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 155/309] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:52 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:53.155110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:53.156373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:53.175859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:53.176388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:53.176819 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:53.177526 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:53.187905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:53.188344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:53.201362 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:16:53.211101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:16:53.261732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:16:53.265027 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:16:53.415691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2cd3be1d-4010-4ef1-b03e-feb4d556f1ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.725545 Aug 26 12:16:53.423307 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 155/310] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:16:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:16:53.464878 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6898a0cd-5427-476f-905a-01d145476c96 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:53.465528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6898a0cd-5427-476f-905a-01d145476c96 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:53.597711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:53.607765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff816046-babc-49a5-a046-9ea518e4e522 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.464127 Aug 26 12:16:53.613961 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 156/311] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:53 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:53.737774 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6898a0cd-5427-476f-905a-01d145476c96 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:53.747398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6898a0cd-5427-476f-905a-01d145476c96 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1241 microversion: 2.1 time: 0.322882 Aug 26 12:16:53.767852 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 156/312] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:53 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1241 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:54.162069 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:54.163084 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:54.196969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:54.207765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:54.210684 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:54.213229 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:54.215244 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:54.218103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:54.505805 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:54.521174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-56e43e00-368b-4e9b-9ac9-bdd4f791fad1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.363948 Aug 26 12:16:54.544602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 157/313] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:54 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:54.633856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:54.634691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:54.650678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:54.651363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:54.652110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:54.653762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:54.655497 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:54.656700 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:54.781585 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:54.783196 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:54.793349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:54.794135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:54.794799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:54.795924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:54.796599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:54.797342 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:54.983524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:54.997129 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff6698a4-55b8-4efb-a490-09a75ad81af4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1237 microversion: 2.1 time: 0.219051 Aug 26 12:16:55.019276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 158/314] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:54 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1237 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:55.199105 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:55.207731 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e0584ac6-f158-431c-ac4c-172c59f6c9c0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.578309 Aug 26 12:16:55.208708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 157/315] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:54 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:55.551650 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:55.552260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:55.577745 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:55.578542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:55.581214 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:55.586065 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:55.593361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:55.594059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:55.695557 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-534ca258-bef2-4b81-8db0-f76aa29b292d req-2a1d1526-da65-4b8a-b305-78b65aa00969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5a14c-01ca-4ad0-94f0-cc7edcd90c48", "name": "network-vif-plugged", "status": "completed", "tag": "2265e6e6-c3fa-4e50-bd81-1d0302423d65"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:55.725752 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-534ca258-bef2-4b81-8db0-f76aa29b292d req-2a1d1526-da65-4b8a-b305-78b65aa00969 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:55.726260 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-534ca258-bef2-4b81-8db0-f76aa29b292d req-2a1d1526-da65-4b8a-b305-78b65aa00969 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:55.726696 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-534ca258-bef2-4b81-8db0-f76aa29b292d req-2a1d1526-da65-4b8a-b305-78b65aa00969 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:55.784851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-534ca258-bef2-4b81-8db0-f76aa29b292d req-2a1d1526-da65-4b8a-b305-78b65aa00969 service nova] Creating event network-vif-plugged:2265e6e6-c3fa-4e50-bd81-1d0302423d65 for instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 on hv-cinder-84630 Aug 26 12:16:55.813964 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-534ca258-bef2-4b81-8db0-f76aa29b292d req-2a1d1526-da65-4b8a-b305-78b65aa00969 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112401 Aug 26 12:16:55.814633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 158/316] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:16:55.891197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-c9220e02-b1d9-4890-a9b7-e5fa6a44f386 req-9066352b-35c9-492f-ae4a-ce052f692d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633ef7a8-d96f-41b4-a43d-786fe1283ac3", "tag": "f6c2f93f-5bf1-4f62-84fc-fd77626a13bf"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:55.915405 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c9220e02-b1d9-4890-a9b7-e5fa6a44f386 req-9066352b-35c9-492f-ae4a-ce052f692d38 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:55.916127 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c9220e02-b1d9-4890-a9b7-e5fa6a44f386 req-9066352b-35c9-492f-ae4a-ce052f692d38 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:55.916711 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c9220e02-b1d9-4890-a9b7-e5fa6a44f386 req-9066352b-35c9-492f-ae4a-ce052f692d38 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:55.944724 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c9220e02-b1d9-4890-a9b7-e5fa6a44f386 req-9066352b-35c9-492f-ae4a-ce052f692d38 service nova] Creating event network-changed:f6c2f93f-5bf1-4f62-84fc-fd77626a13bf for instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 on hv-cinder-84630 Aug 26 12:16:55.955246 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-c9220e02-b1d9-4890-a9b7-e5fa6a44f386 req-9066352b-35c9-492f-ae4a-ce052f692d38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068055 Aug 26 12:16:55.956423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 159/317] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:16:55.963472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:55.976905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c812c03b-87f8-4dac-a65f-f5cf0f4d186b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.429079 Aug 26 12:16:55.983587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 159/318] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:55 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:56.043584 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:56.045024 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:56.054234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:56.055261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:56.056266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:56.057240 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:56.057567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:56.057995 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:56.152067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:56.164012 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-74157fe9-7fae-4c0b-9efd-a64761dffddc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1293 microversion: 2.1 time: 0.126189 Aug 26 12:16:56.165659 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 160/319] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:56 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1293 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:56.230029 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:56.230650 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:56.241204 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:56.241600 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:56.242036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:56.242755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:56.243390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:56.247317 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:56.459314 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:56.469442 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcca5751-07b8-4bc7-a398-ec732a83c919 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.244206 Aug 26 12:16:56.473695 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 160/320] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:56 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:57.017556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:57.018299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:57.032575 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:57.033716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:57.034164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:57.034875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:57.037957 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:57.039269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:57.184797 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:57.185667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:57.200900 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:57.206188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:57.206902 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:57.209653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:57.210377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:57.211025 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:57.234720 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:57.247345 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e594d75e-b1a2-42d4-87d7-c107d9e510ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.234634 Aug 26 12:16:57.248551 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 161/321] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:57 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:57.307082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:57.314789 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1068c66-2a7b-4490-9887-b2a035997b7e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1293 microversion: 2.1 time: 0.134317 Aug 26 12:16:57.315565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 161/322] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:57 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:57.502435 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:57.503578 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:57.520382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:57.521143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:57.521885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:57.522798 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:57.524846 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:57.526170 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:57.695457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:57.705857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-502d82eb-64bd-45c0-ab28-5373621b6c5f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.209656 Aug 26 12:16:57.706776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 162/323] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:57 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:58.270267 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:58.270801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:58.277307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:58.278069 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:58.278716 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:58.279664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:58.280180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:58.280603 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:58.341881 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:58.342490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:58.354300 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:58.355190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:58.355728 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:58.356522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:58.357049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:58.361453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:58.452240 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:58.471808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:58.487162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-087769a6-fb27-4259-b7ce-e413a7389837 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1293 microversion: 2.1 time: 0.143982 Aug 26 12:16:58.487162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 163/324] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:58 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1293 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:58.501155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-097204bd-7694-4573-98b3-d14d26f460c2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1722 microversion: 2.1 time: 0.234620 Aug 26 12:16:58.502221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 162/325] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:58 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:58.726404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:58.735014 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:58.743744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:58.744626 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:58.745400 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:58.746353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:58.747044 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:58.747732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:58.990501 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:58.999732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c402c00e-ce19-4a46-ade7-964e2b45950d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.277176 Aug 26 12:16:59.000571 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 164/326] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:58 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:16:59.505882 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:59.506495 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:59.513925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:59.515374 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:59.516051 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:59.517063 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:59.517708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:59.518440 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:59.522526 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:59.523246 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:59.535657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:59.537330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:59.541412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:59.542549 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:59.543788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:59.545492 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:59.724900 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:59.736563 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8e14c4d-fb76-418e-942b-dedadca3fe38 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1299 microversion: 2.1 time: 0.233380 Aug 26 12:16:59.737175 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 163/327] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:59 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1299 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:59.794491 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:16:59.804180 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b00d3256-3746-48d1-aa9e-d6f8178b7295 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1699 microversion: 2.1 time: 0.285624 Aug 26 12:16:59.805306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 165/328] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:59 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1699 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:16:59.827481 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f651497-0a96-4b5a-8365-7858ddfaf175 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:16:59.836037 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f651497-0a96-4b5a-8365-7858ddfaf175 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:59.838220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f651497-0a96-4b5a-8365-7858ddfaf175 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:59.838954 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f651497-0a96-4b5a-8365-7858ddfaf175 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:59.862157 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:16:59.885820 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f651497-0a96-4b5a-8365-7858ddfaf175 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Going to try to start instance {{(pid=120698) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 12:16:59.972165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f651497-0a96-4b5a-8365-7858ddfaf175 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action" status: 202 len: 0 microversion: 2.1 time: 0.149005 Aug 26 12:16:59.973444 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 164/329] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:16:59 2022] POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:16:59.983217 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:16:59.984323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:16:59.993258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:59.994236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:59.994902 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:16:59.995806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:16:59.996287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:16:59.996722 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:00.021668 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:00.021668 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:00.038649 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:00.039152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:00.039688 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:00.041587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:00.042288 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:00.042906 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:00.536400 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:00.552202 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b0aab5ae-323e-4b0b-ad39-6de4a05ca5b1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1370 microversion: 2.1 time: 0.535301 Aug 26 12:17:00.553317 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 165/330] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:00 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1370 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:00.616186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:00.631564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-08118f77-8c2c-4b4c-9485-d6accf886b4a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1708 microversion: 2.1 time: 0.653100 Aug 26 12:17:00.632437 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 166/331] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:16:59 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1708 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:00.760851 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:00.761500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:00.776585 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:00.777393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:00.778030 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:00.781139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:00.782135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:00.782741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:00.938332 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:00.968264 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88b8768b-5f05-45d3-ab5f-473ecb23e26b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1299 microversion: 2.1 time: 0.211037 Aug 26 12:17:00.970375 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 166/332] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:00 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1299 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:01.577748 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:01.578763 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:01.596792 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:01.598178 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:01.599388 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:01.600966 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:01.601611 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:01.602305 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:01.653524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:01.655141 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:01.672287 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:01.672796 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:01.673245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:01.673963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:01.674415 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:01.674858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:01.986392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:02.025113 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7a530424-6520-4a34-bfc6-9017e5bee456 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1564 microversion: 2.1 time: 0.453749 Aug 26 12:17:02.028728 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 167/333] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:01 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1564 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:02.036642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:02.038917 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:02.052744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:02.053648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:02.054385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:02.055710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:02.056383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:02.057548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:02.074586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:02.089143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da5dc01a-efaa-4188-82f7-cfcd8d544d8f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1708 microversion: 2.1 time: 0.439842 Aug 26 12:17:02.089867 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 167/334] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:01 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1708 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:02.119489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:02.120002 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:02.132412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:02.132924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:02.137168 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:02.138391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:02.138502 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:02.138944 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:02.336937 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f851b075-b46f-4242-9009-eb5e42e43294 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231140 Aug 26 12:17:02.337717 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 168/335] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:17:02 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-interface => generated 285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:02.423055 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:02.436276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85cea7e5-be78-41c9-8188-30bc0323ab9e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.406190 Aug 26 12:17:02.436860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 168/336] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:02 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:03.112095 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:03.113832 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:03.122202 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:03.123103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:03.123786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:03.124618 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:03.125166 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:03.125690 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:03.218768 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:03.226929 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-6053131a-74a1-43e3-8d29-a31cd2fa9652 req-0466c73c-296b-4d47-bbb6-017f9af3e05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6927fcc-8685-4602-9ac7-c09fcde9d05c", "tag": "8f66372a-f26e-42ef-834e-6e88cd004c10"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:03.253946 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6053131a-74a1-43e3-8d29-a31cd2fa9652 req-0466c73c-296b-4d47-bbb6-017f9af3e05e service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:03.255550 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6053131a-74a1-43e3-8d29-a31cd2fa9652 req-0466c73c-296b-4d47-bbb6-017f9af3e05e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:03.256831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6053131a-74a1-43e3-8d29-a31cd2fa9652 req-0466c73c-296b-4d47-bbb6-017f9af3e05e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:03.273489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6053131a-74a1-43e3-8d29-a31cd2fa9652 req-0466c73c-296b-4d47-bbb6-017f9af3e05e service nova] Creating event network-changed:8f66372a-f26e-42ef-834e-6e88cd004c10 for instance e6927fcc-8685-4602-9ac7-c09fcde9d05c on hv-cinder-84630 Aug 26 12:17:03.279866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-6053131a-74a1-43e3-8d29-a31cd2fa9652 req-0466c73c-296b-4d47-bbb6-017f9af3e05e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062189 Aug 26 12:17:03.281146 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 169/337] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:17:03.297540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:03.310194 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2ccbd09-50d5-4798-8f99-acc5ffd3e044 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1708 microversion: 2.1 time: 0.202709 Aug 26 12:17:03.323368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 169/338] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:03 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1708 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:03.458387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:03.459494 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:03.467904 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:03.468753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:03.469436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:03.470500 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:03.472646 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:03.473322 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:03.526040 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:03.748829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=14 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:03.773506 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:03.799782 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-86c5d5e6-f01d-41d8-9436-cb49e4fc7f7d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.344685 Aug 26 12:17:03.800622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 170/339] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:03 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:03.826740 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f562d2c0-93cd-4b7c-bcbe-ae86f704d706 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Action: 'create', calling method: .version_select at 0x7ffa97855670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1521648394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQcFy0sB81ooQijoiLuzwOSbisw+TDGB67lkcO92YIdzuIF0KzOTIwZDSi+cmi/h5Qfu8hpCDzEFo0J42GqS5r1vPcis+NrJUdgGSzxqH3IpRdx3ezx6seSYQd2bS/1VQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:03.848969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-f562d2c0-93cd-4b7c-bcbe-ae86f704d706 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Getting quotas for project 1f876d0f217a485392ddcbd79134f609. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:17:03.856208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-f562d2c0-93cd-4b7c-bcbe-ae86f704d706 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Getting quotas for user ceed3909469f409189d9ed93937003f0 and project 1f876d0f217a485392ddcbd79134f609. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:17:03.875799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:03.885243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f562d2c0-93cd-4b7c-bcbe-ae86f704d706 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.062939 Aug 26 12:17:03.885839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 170/340] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:17:03 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:04.090905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-390976002", "imageRef": "eebad682-db29-4bfe-9317-cc55a790dac2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1521648394", "networks": [{"uuid": "f30729ee-0bfc-4d22-9b14-928a3fea9647"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:04.154465 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] validate_networks() for [('f30729ee-0bfc-4d22-9b14-928a3fea9647', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:17:04.335615 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:04.336947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:04.344728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:04.345486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:04.346541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:04.347758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:04.348425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:04.349051 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:04.655148 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:04.663577 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7e5bdf4-3a70-4f32-a0e0-72d80504f429 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1712 microversion: 2.1 time: 0.334310 Aug 26 12:17:04.664153 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 171/341] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:04 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1712 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:04.692553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:17:04.693044 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:17:04.693447 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:17:04.693859 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:17:04.694272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:17:04.704238 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:04.704755 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:04.705193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:04.705926 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:04.706380 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:04.706805 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:04.723837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Getting quotas for project 1f876d0f217a485392ddcbd79134f609. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:17:04.728475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Getting quotas for user ceed3909469f409189d9ed93937003f0 and project 1f876d0f217a485392ddcbd79134f609. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:17:04.741937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:17:04.755183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='eebad682-db29-4bfe-9317-cc55a790dac2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:17:04.830048 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:04.832053 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:04.844753 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:04.845445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:04.845879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:04.849048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9d629b7e-541d-4a95-8b80-d6c7a0129522 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765477 Aug 26 12:17:04.849705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:04.850188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:04.851185 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 171/342] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:17:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:17:04.852561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:04.868931 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-66165ce5-2108-4215-bc67-10ad6ec8e744 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:04.871096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-66165ce5-2108-4215-bc67-10ad6ec8e744 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:05.000058 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-66165ce5-2108-4215-bc67-10ad6ec8e744 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:05.016482 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-66165ce5-2108-4215-bc67-10ad6ec8e744 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1258 microversion: 2.1 time: 0.157483 Aug 26 12:17:05.031231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 172/343] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:04 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:05.140382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:05.150924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a4a0b83-8bcb-49e9-8888-b38f90601b4c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.325902 Aug 26 12:17:05.155249 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 172/344] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:04 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:05.320784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-25b5387d-4299-4f00-b8c7-698cfb4ec553 req-b3b05f2c-40f3-45e3-ad18-118efcce85b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5a14c-01ca-4ad0-94f0-cc7edcd90c48", "tag": "2265e6e6-c3fa-4e50-bd81-1d0302423d65"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:05.341088 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-25b5387d-4299-4f00-b8c7-698cfb4ec553 req-b3b05f2c-40f3-45e3-ad18-118efcce85b0 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:05.342537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-25b5387d-4299-4f00-b8c7-698cfb4ec553 req-b3b05f2c-40f3-45e3-ad18-118efcce85b0 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:05.343166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-25b5387d-4299-4f00-b8c7-698cfb4ec553 req-b3b05f2c-40f3-45e3-ad18-118efcce85b0 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:05.358133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-25b5387d-4299-4f00-b8c7-698cfb4ec553 req-b3b05f2c-40f3-45e3-ad18-118efcce85b0 service nova] Creating event network-changed:2265e6e6-c3fa-4e50-bd81-1d0302423d65 for instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 on hv-cinder-84630 Aug 26 12:17:05.364409 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-25b5387d-4299-4f00-b8c7-698cfb4ec553 req-b3b05f2c-40f3-45e3-ad18-118efcce85b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051699 Aug 26 12:17:05.365388 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 173/345] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:05.788869 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-341908907", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "networks": [{"uuid": "0eda80e6-13df-4bb1-9519-bd888a696b92"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:05.851857 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] validate_networks() for [('0eda80e6-13df-4bb1-9519-bd888a696b92', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:17:06.044318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:06.046356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:06.054543 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:06.055138 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:06.056275 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:06.057242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:06.057866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:06.058299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:06.164522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:06.176345 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-03d32e1d-2248-4c3d-b5ca-f4d1a5dc4a0f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1262 microversion: 2.1 time: 0.137010 Aug 26 12:17:06.187747 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 174/346] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:06 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:06.201657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:06.203174 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:06.207124 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:06.212760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:06.213330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:06.213775 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:06.214788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:06.215332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:06.215764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:06.334546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:17:06.335144 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:17:06.335760 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:17:06.336325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:17:06.337746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:17:06.353638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:06.354604 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:06.355055 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:06.355932 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:06.356596 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:06.357368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:06.385671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Getting quotas for project 2ab22ea009914891b1f594ed3d1e4ec3. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:17:06.391222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Getting quotas for user a7d0a1ee39274a0d90a2be9fbc26a58b and project 2ab22ea009914891b1f594ed3d1e4ec3. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:17:06.409226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:17:06.411914 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:17:06.445396 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:06.458301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6c761306-8cba-451d-b26b-e4d8a3e1b532 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.269002 Aug 26 12:17:06.458883 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 175/347] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:06 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:06.476539 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aedf683f-db13-42a4-a027-65bd3ab81551 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691513 Aug 26 12:17:06.478850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 173/348] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:17:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:17:06.490193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-216a333b-b3a5-4cc1-9a2f-668da4ff56c7 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:06.491066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-216a333b-b3a5-4cc1-9a2f-668da4ff56c7 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:06.588924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-216a333b-b3a5-4cc1-9a2f-668da4ff56c7 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:06.599692 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-216a333b-b3a5-4cc1-9a2f-668da4ff56c7 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1218 microversion: 2.1 time: 0.113307 Aug 26 12:17:06.600801 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 176/349] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:06 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:07.199686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:07.200428 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:07.214219 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:07.215029 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:07.215547 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:07.219364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:07.220483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:07.225076 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:07.307970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:07.316686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-830f5c85-d243-40fd-822b-832d5ee789c9 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1328 microversion: 2.1 time: 0.123066 Aug 26 12:17:07.317920 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 174/350] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:07 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:07.481213 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:07.481820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:07.489174 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:07.489573 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:07.490009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:07.490959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:07.491447 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:07.491864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:07.625956 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:07.626580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:07.639615 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:07.640224 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:07.640808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:07.641529 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:07.641987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:07.642413 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:07.656032 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:07.667503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96ba1b06-bdc8-43b8-bbfd-af4cd27e1903 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.190681 Aug 26 12:17:07.668723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 177/351] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:07 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:07.778138 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:07.786520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45786afc-254b-4f47-976e-eebaf83ef4fa tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.164479 Aug 26 12:17:07.787863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 175/352] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:07 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:08.342414 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:08.343485 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:08.350886 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:08.351439 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:08.351983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:08.352863 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:08.353321 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:08.353746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:08.504491 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:08.512418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b29f01f3-4177-4cd8-ae4f-7329c58e5665 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.176019 Aug 26 12:17:08.512968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 178/353] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:08 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:08.689639 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:08.690305 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:08.701756 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:08.702562 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:08.703338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:08.704341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:08.705027 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:08.705677 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:08.811861 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:08.812519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:08.824045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:08.832269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:08.833070 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:08.833975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:08.834601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:08.835585 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:08.861363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:08.870287 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbdf9bc1-e02c-4c72-9a77-c8321124dffa tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.184639 Aug 26 12:17:08.870873 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 176/354] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:08 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:08.928727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:08.937249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f953e860-90bb-439e-a1fe-c736b4dd868a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.129360 Aug 26 12:17:08.938393 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 179/355] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:08 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:09.283232 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b7414cb3-3497-4600-bd23-861d5f3c6586 req-a302bb35-cfc9-41f9-bd24-ce292d12c0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6927fcc-8685-4602-9ac7-c09fcde9d05c", "name": "network-vif-plugged", "status": "completed", "tag": "8f66372a-f26e-42ef-834e-6e88cd004c10"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:09.293856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b7414cb3-3497-4600-bd23-861d5f3c6586 req-a302bb35-cfc9-41f9-bd24-ce292d12c0df service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:09.294431 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b7414cb3-3497-4600-bd23-861d5f3c6586 req-a302bb35-cfc9-41f9-bd24-ce292d12c0df service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:09.294930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b7414cb3-3497-4600-bd23-861d5f3c6586 req-a302bb35-cfc9-41f9-bd24-ce292d12c0df service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:09.306755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b7414cb3-3497-4600-bd23-861d5f3c6586 req-a302bb35-cfc9-41f9-bd24-ce292d12c0df service nova] Creating event network-vif-plugged:8f66372a-f26e-42ef-834e-6e88cd004c10 for instance e6927fcc-8685-4602-9ac7-c09fcde9d05c on hv-cinder-84630 Aug 26 12:17:09.311852 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b7414cb3-3497-4600-bd23-861d5f3c6586 req-a302bb35-cfc9-41f9-bd24-ce292d12c0df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Aug 26 12:17:09.312526 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 177/356] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:09.535441 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:09.537389 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:09.547171 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:09.548191 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:09.549029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:09.550176 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:09.550905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:09.552018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:09.690024 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:09.705210 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-12319119-9c81-4020-b1a1-b9d8b399bef2 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.175279 Aug 26 12:17:09.708423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 180/357] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:09 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:09.891514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:09.892125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:09.898245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:09.898758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:09.899193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:09.899988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:09.900437 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:09.900862 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:09.961021 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:09.962475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:09.971005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:09.972996 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:09.973452 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:09.974201 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:09.974665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:09.979736 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:10.058840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:10.066492 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-94529990-7d83-4c97-8fe8-50b32beb140e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.110384 Aug 26 12:17:10.067049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 181/358] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:09 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:10.081277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:10.090139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb586c83-0e5e-4670-908f-a9500fb00c68 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.203295 Aug 26 12:17:10.090884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 178/359] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:09 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:10.727474 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:10.728329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:10.736131 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:10.736898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:10.737582 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:10.738330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:10.738839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:10.744533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:10.896503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:10.905277 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1eb63e34-0c76-4d41-8938-e4f7d4324c1c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.183185 Aug 26 12:17:10.911464 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 182/360] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:10 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:11.089254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:11.089824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:11.096278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:11.096989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:11.097426 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:11.098184 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:11.098635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:11.099084 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:11.112535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:11.113163 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:11.120927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:11.121455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:11.121927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:11.122697 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:11.123308 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:11.123738 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:11.182939 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:11.194899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc534154-54d6-40a1-9ee4-1bee2f73a3f2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.110417 Aug 26 12:17:11.195525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 179/361] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:11 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:11.293323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:11.300916 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ce7f1b0-20f8-4d36-9219-93b74504d1c5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.192306 Aug 26 12:17:11.301480 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 183/362] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:11 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:11.927590 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:11.928193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:11.934205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:11.934685 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:11.935119 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:11.935864 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:11.936311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:11.936728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:12.066518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:12.074319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95438ba7-fa02-45bf-884a-c7c7db73f256 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.151898 Aug 26 12:17:12.083704 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 180/363] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:11 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:12.216045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:12.216601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:12.226569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:12.227052 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:12.227518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:12.228203 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:12.228650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:12.229065 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:12.296191 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:12.306078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0bd36b60-00b0-45bb-bdde-e1c211cda6e8 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.094278 Aug 26 12:17:12.312194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 184/364] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:12 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:12.322489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:12.323324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:12.331149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:12.331957 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:12.332738 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:12.333853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:12.334550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:12.335550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:12.486469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:12.495593 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de84df65-50ad-4a69-9760-030fca39482d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.177292 Aug 26 12:17:12.507848 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 181/365] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:12 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:13.095667 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:13.096272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:13.102697 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:13.103172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:13.103621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:13.104300 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:13.104745 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:13.105161 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:13.238597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:13.248139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d50faca-cd83-4991-8e74-1d03dc1328d1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.156166 Aug 26 12:17:13.261913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 185/366] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:13 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:13.327524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:13.328117 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:13.334452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:13.334934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:13.335403 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:13.336086 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:13.337085 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:13.337506 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:13.352445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:13.400731 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:13.408327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e363038a-a4dd-4b48-9839-e0a0b4a340e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.084741 Aug 26 12:17:13.408884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 182/367] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:13 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:13.518896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:13.520059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:13.528599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:13.529382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:13.530167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:13.531560 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:13.532259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:13.532911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:13.669296 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:13.676807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1fa377d2-8989-46b7-ab2d-a8a4d7b54824 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.163070 Aug 26 12:17:13.677369 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 186/368] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:13 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:14.269022 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:14.269657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:14.275708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:14.276185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:14.276614 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:14.277294 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:14.277743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:14.278164 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:14.425436 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:14.429337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:14.430471 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:14.433905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db06ea5a-3d54-42a0-b4df-4654e11cbef7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.168800 Aug 26 12:17:14.434468 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 183/369] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:14 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:14.436758 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:14.437242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:14.437675 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:14.438372 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:14.438827 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:14.439274 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:14.505648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:14.514491 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f4356ae0-8e9a-4d91-91f6-a5c484f32368 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.088827 Aug 26 12:17:14.515067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 187/370] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:14 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:14.698316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:14.698925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:14.705728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:14.706215 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:14.706640 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:14.707363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:14.707833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:14.708341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:14.867545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:14.875288 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9ddfe4b-b7b2-4116-8918-011d7fce332f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.181499 Aug 26 12:17:14.875854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 184/371] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:14 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:15.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:15.456706 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:15.458680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:15.466071 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:15.466760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:15.467346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:15.468079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:15.468630 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:15.469064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:15.535504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:15.536115 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:15.542612 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:15.543092 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:15.543593 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:15.544289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:15.544752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:15.545173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:15.619258 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:15.623640 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:15.627462 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86ffd48b-8367-4f24-ace4-1a363df2f7eb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.095758 Aug 26 12:17:15.628044 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 185/372] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:15 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:15.631663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4e8fa803-c6c4-4328-ac48-25c43761ea76 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.180115 Aug 26 12:17:15.632091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 188/373] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:15 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:15.895732 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:15.896396 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:15.902779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:15.903380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:15.903883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:15.904654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:15.905209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:15.905716 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:16.054492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:16.066208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d71ba998-89b3-43d7-8d29-b017a4f374cd tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.174284 Aug 26 12:17:16.066813 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 186/374] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:15 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:16.650084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:16.650674 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:16.653004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=10 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:16.653547 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:16.654223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:16.656191 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:16.656910 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:16.658278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:16.658520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:16.658947 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:16.659659 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:16.660119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:16.660630 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:16.663747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:16.664313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:16.665028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:16.665549 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:16.666585 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:16.667034 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:16.767057 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:16.777426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-34121b3b-465d-41d5-a391-b12e0af5d571 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.131753 Aug 26 12:17:16.781714 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 189/375] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:16 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:16.821755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:16.831539 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91740057-4f63-41ee-8728-5c3f2afb2507 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.182448 Aug 26 12:17:16.832326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 187/376] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:16 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:17.088082 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:17.088805 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:17.094965 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:17.095497 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:17.095940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:17.096642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:17.097107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:17.097528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:17.113831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:17.249439 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:17.257523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5c254182-6554-4a79-ae7b-8ca777b11c8e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.174143 Aug 26 12:17:17.263190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 190/377] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:17 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:17.797735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:17.798336 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:17.804674 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:17.805790 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:17.806222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:17.806905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:17.807382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:17.807817 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:17.852796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:17.853631 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:17.860866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:17.861557 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:17.862065 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:17.862839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:17.863331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:17.863765 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:17.869122 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:17.876708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a621cbb5-4edf-4763-be3e-8db19525069a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1270 microversion: 2.1 time: 0.082788 Aug 26 12:17:17.877260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 188/378] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:17 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:17.995030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:18.002535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-61609ee9-026a-4c62-8e9f-6253e9b0fd10 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.154311 Aug 26 12:17:18.003091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 191/379] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:17 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:18.280211 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:18.281269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:18.287981 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:18.288763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:18.289399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:18.290293 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:18.290940 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:18.291542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:18.532904 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:18.545268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9453ef8-2859-4a2c-b91a-c09b9a72112d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.268775 Aug 26 12:17:18.545857 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 189/380] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:18 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:18.898828 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:18.899630 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:18.906164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:18.906730 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:18.907163 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:18.907886 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:18.908341 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:18.908758 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:19.024932 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:19.025648 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:19.032647 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:19.033152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:19.033598 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:19.034950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:19.035430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:19.035858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:19.195078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:19.203937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-94127ab7-d3c9-4373-afe8-5ae2810698f3 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1276 microversion: 2.1 time: 0.308975 Aug 26 12:17:19.204781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 192/381] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:18 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:19.331487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:19.339966 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9991e2eb-8aa5-4556-a2d2-35aa38aa3ea7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.320346 Aug 26 12:17:19.340666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 190/382] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:19 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:19.550981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-31db7793-d524-4ddf-af28-39ecf170ca23 req-23ee9b93-9b7c-461e-ba44-0705a1d7b659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636be5ae-16a1-4ef8-9d5e-649c32df46c2", "tag": "23eb6509-4bf3-4d20-8514-4a082338c7ce"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:19.560889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-31db7793-d524-4ddf-af28-39ecf170ca23 req-23ee9b93-9b7c-461e-ba44-0705a1d7b659 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:19.561373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-31db7793-d524-4ddf-af28-39ecf170ca23 req-23ee9b93-9b7c-461e-ba44-0705a1d7b659 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:19.561800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-31db7793-d524-4ddf-af28-39ecf170ca23 req-23ee9b93-9b7c-461e-ba44-0705a1d7b659 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:19.567458 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:19.568078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:19.573638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-31db7793-d524-4ddf-af28-39ecf170ca23 req-23ee9b93-9b7c-461e-ba44-0705a1d7b659 service nova] Creating event network-changed:23eb6509-4bf3-4d20-8514-4a082338c7ce for instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 on hv-cinder-84630 Aug 26 12:17:19.575162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:19.575863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:19.576484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:19.577356 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:19.577972 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:19.578696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:19.580222 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-31db7793-d524-4ddf-af28-39ecf170ca23 req-23ee9b93-9b7c-461e-ba44-0705a1d7b659 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032923 Aug 26 12:17:19.580820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 193/383] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:19.794988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:19.803176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff7da15c-f35a-44a1-a01d-ee600114a4d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1366 microversion: 2.1 time: 0.241206 Aug 26 12:17:19.803985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 191/384] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:19 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:20.226188 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:20.226889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:20.233630 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:20.234235 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:20.234749 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:20.235699 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:20.236233 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:20.236666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:20.360619 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:20.361998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:20.383991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:20.388780 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:20.392507 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:20.393015 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:20.393947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:20.394473 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:20.394970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:20.396714 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a0906a0c-a0a6-42ce-80ab-5c4c7c303843 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.174710 Aug 26 12:17:20.397315 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 194/385] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:20 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:20.559978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:20.568109 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40b31e54-524d-4779-9ed8-e4201c215336 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.212054 Aug 26 12:17:20.568679 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 192/386] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:20 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:20.823767 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:20.824371 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:20.830556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:20.831128 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:20.831597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:20.832298 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:20.832928 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:20.833260 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:20.971366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:20.981214 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a99c7cb4-9b7a-4ff0-9f00-03bdbfd4e7a2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1556 microversion: 2.1 time: 0.161439 Aug 26 12:17:20.981794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 195/387] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:20 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:21.001529 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:21.002031 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:21.008192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:21.008650 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:21.009091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:21.009800 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:21.010260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:21.010687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:21.090555 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a4f75040-47a4-4322-998f-2f6d3c01018b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092845 Aug 26 12:17:21.091153 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 193/388] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:17:20 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:21.417506 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:21.418113 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:21.432153 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:21.432644 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:21.433076 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:21.433772 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:21.434222 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:21.434640 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:21.581402 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:21.590418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0d46eab1-7b78-47ec-907c-43852146389b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.176785 Aug 26 12:17:21.591165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:21.591812 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 196/389] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:21 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:21.591911 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:21.598266 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:21.598751 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:21.599184 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:21.599985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:21.600583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:21.601020 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:21.738008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:21.752278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41800402-a1f3-40bb-bb82-6908ab1b4ebd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.165799 Aug 26 12:17:21.752876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 194/390] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:21 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:21.872393 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0b78818c-fbd2-45ca-a31f-13d09b612f02 req-8cd39b4f-dc0a-4a3e-b99e-c62330576bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "564aca9b-b30b-43f8-80b6-8f8cacadb414", "tag": "608668a6-1d28-49d2-ac5e-911edbc56091"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:21.881507 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b78818c-fbd2-45ca-a31f-13d09b612f02 req-8cd39b4f-dc0a-4a3e-b99e-c62330576bf3 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:21.881990 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b78818c-fbd2-45ca-a31f-13d09b612f02 req-8cd39b4f-dc0a-4a3e-b99e-c62330576bf3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:21.882418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b78818c-fbd2-45ca-a31f-13d09b612f02 req-8cd39b4f-dc0a-4a3e-b99e-c62330576bf3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:21.893594 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0b78818c-fbd2-45ca-a31f-13d09b612f02 req-8cd39b4f-dc0a-4a3e-b99e-c62330576bf3 service nova] Creating event network-changed:608668a6-1d28-49d2-ac5e-911edbc56091 for instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 on hv-cinder-84630 Aug 26 12:17:21.898269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0b78818c-fbd2-45ca-a31f-13d09b612f02 req-8cd39b4f-dc0a-4a3e-b99e-c62330576bf3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029642 Aug 26 12:17:21.899048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 197/391] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:22.611139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:22.612100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:22.619060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:22.619574 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:22.620003 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:22.620692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:22.621135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:22.621549 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:22.775193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:22.776796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:22.778799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:22.784466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:22.785224 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:22.785988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:22.786975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:22.787629 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:22.788211 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:22.788352 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36bc1e0b-2adb-454f-8a6a-ea49db96d24a tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.180885 Aug 26 12:17:22.795856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 195/392] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:22 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:22.926141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:22.935001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-34b88fce-5781-4a73-81da-fcea0f52a31a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.165083 Aug 26 12:17:22.935614 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 198/393] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:22 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:23.810020 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:23.810625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:23.816956 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:23.817432 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:23.817862 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:23.818545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:23.818990 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:23.819431 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:23.920480 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-c6b318ef-75b5-48c6-b2bd-38adc8682f46 req-66ea0597-ba3a-48a5-ab31-0b252f7b2d54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6927fcc-8685-4602-9ac7-c09fcde9d05c", "tag": "8f66372a-f26e-42ef-834e-6e88cd004c10"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:23.930401 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6b318ef-75b5-48c6-b2bd-38adc8682f46 req-66ea0597-ba3a-48a5-ab31-0b252f7b2d54 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:23.930974 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6b318ef-75b5-48c6-b2bd-38adc8682f46 req-66ea0597-ba3a-48a5-ab31-0b252f7b2d54 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:23.931516 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6b318ef-75b5-48c6-b2bd-38adc8682f46 req-66ea0597-ba3a-48a5-ab31-0b252f7b2d54 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:23.942231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c6b318ef-75b5-48c6-b2bd-38adc8682f46 req-66ea0597-ba3a-48a5-ab31-0b252f7b2d54 service nova] Creating event network-changed:8f66372a-f26e-42ef-834e-6e88cd004c10 for instance e6927fcc-8685-4602-9ac7-c09fcde9d05c on hv-cinder-84630 Aug 26 12:17:23.947659 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-c6b318ef-75b5-48c6-b2bd-38adc8682f46 req-66ea0597-ba3a-48a5-ab31-0b252f7b2d54 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030642 Aug 26 12:17:23.948189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 199/394] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:17:23.955129 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:23.956539 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:23.957244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:23.963692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e811de44-61ad-4428-872b-b92ebfe625cc tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.158165 Aug 26 12:17:23.964029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:23.964515 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 196/395] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:23 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:23.964646 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:23.964942 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:23.965639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:23.966097 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:23.966523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:24.100729 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:24.108975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bacf6a58-dda7-445b-aa79-3ae0ce82ee0c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.156545 Aug 26 12:17:24.109621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 200/396] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:23 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:24.984201 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:24.984825 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:24.991382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:24.991858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:24.992293 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:24.993580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:24.994031 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:24.994449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:25.122032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:25.129691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:25.130218 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68971795-999f-4a28-83aa-2f41fbd21e33 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.149619 Aug 26 12:17:25.130336 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:25.131235 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 197/397] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:24 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:25.136618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:25.137098 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:25.137529 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:25.138214 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:25.138664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:25.139081 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:25.274817 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:25.282786 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8648e8cf-35f2-411a-8da2-ef4c858d0fb4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.156852 Aug 26 12:17:25.283385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 201/398] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:25 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:26.151041 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:26.151667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:26.158015 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:26.158487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:26.158914 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:26.159622 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:26.160068 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:26.160483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:26.286789 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:26.294424 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8e56a83-db19-439e-9b7a-3f3512dfb46e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.147438 Aug 26 12:17:26.294978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 198/399] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:26 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:26.304210 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:26.304908 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:26.311822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:26.312297 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:26.312794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:26.313478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:26.313935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:26.314351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:26.443765 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:26.452126 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-46cdb5f7-2e1b-497f-8041-8d73c7898947 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.151691 Aug 26 12:17:26.452690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 202/400] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:26 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:17:27.315560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:27.316163 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:27.324265 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:27.324764 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:27.325202 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:27.325908 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:27.326361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:27.326786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:27.342989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:27.458837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:27.470644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ac51f43-bd8d-43e1-8ebb-0541618e6381 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.158258 Aug 26 12:17:27.471702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 199/401] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:27 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:27.476008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:27.477871 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:27.480721 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-074834e7-827a-4f9f-99cf-3f07dd8db702 req-0063c340-da65-49d3-b66d-97e27d137c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636be5ae-16a1-4ef8-9d5e-649c32df46c2", "name": "network-vif-plugged", "status": "completed", "tag": "23eb6509-4bf3-4d20-8514-4a082338c7ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:27.486073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:27.486645 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:27.487083 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:27.488077 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:27.488556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:27.488978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:27.491316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-074834e7-827a-4f9f-99cf-3f07dd8db702 req-0063c340-da65-49d3-b66d-97e27d137c9b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:27.491886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-074834e7-827a-4f9f-99cf-3f07dd8db702 req-0063c340-da65-49d3-b66d-97e27d137c9b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:27.492470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-074834e7-827a-4f9f-99cf-3f07dd8db702 req-0063c340-da65-49d3-b66d-97e27d137c9b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:27.505289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-074834e7-827a-4f9f-99cf-3f07dd8db702 req-0063c340-da65-49d3-b66d-97e27d137c9b service nova] Creating event network-vif-plugged:23eb6509-4bf3-4d20-8514-4a082338c7ce for instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 on hv-cinder-84630 Aug 26 12:17:27.512662 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-074834e7-827a-4f9f-99cf-3f07dd8db702 req-0063c340-da65-49d3-b66d-97e27d137c9b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035870 Aug 26 12:17:27.513314 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 200/402] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:27.628231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:27.636930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fee3c3b5-dc68-49e1-9391-f1e5106c7e98 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.165581 Aug 26 12:17:27.637597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 203/403] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:27 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:28.494437 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:28.495132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:28.501308 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:28.501786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:28.502217 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:28.502901 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:28.503385 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:28.503816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:28.636307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:28.643883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b899e45e-d89c-4808-bee4-ed907cddbc24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.154422 Aug 26 12:17:28.644441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 201/404] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:28 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:28.657866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:28.658514 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:28.664532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:28.665020 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:28.665459 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:28.666153 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:28.666606 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:28.667060 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:28.800186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:28.808463 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96c3f647-0275-4bff-ac13-ba8471bd1419 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1358 microversion: 2.1 time: 0.154693 Aug 26 12:17:28.809027 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 204/405] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:28 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:29.543968 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0bcb48a7-01ff-4bb8-8a43-fbe13e1a05ed req-a4154458-9b39-4c9c-889b-2214de8fc746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564aca9b-b30b-43f8-80b6-8f8cacadb414", "name": "network-vif-plugged", "status": "completed", "tag": "608668a6-1d28-49d2-ac5e-911edbc56091"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:29.554345 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0bcb48a7-01ff-4bb8-8a43-fbe13e1a05ed req-a4154458-9b39-4c9c-889b-2214de8fc746 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:29.554904 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0bcb48a7-01ff-4bb8-8a43-fbe13e1a05ed req-a4154458-9b39-4c9c-889b-2214de8fc746 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:29.557427 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0bcb48a7-01ff-4bb8-8a43-fbe13e1a05ed req-a4154458-9b39-4c9c-889b-2214de8fc746 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:29.568064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0bcb48a7-01ff-4bb8-8a43-fbe13e1a05ed req-a4154458-9b39-4c9c-889b-2214de8fc746 service nova] Creating event network-vif-plugged:608668a6-1d28-49d2-ac5e-911edbc56091 for instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 on hv-cinder-84630 Aug 26 12:17:29.573008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0bcb48a7-01ff-4bb8-8a43-fbe13e1a05ed req-a4154458-9b39-4c9c-889b-2214de8fc746 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034155 Aug 26 12:17:29.573669 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 202/406] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:29.665434 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:29.666129 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:29.672699 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:29.673191 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:29.673626 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:29.674325 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:29.674800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:29.675235 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:29.811258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:29.818835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5426321b-5a9e-4d2a-938b-4658b527fe90 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.157912 Aug 26 12:17:29.819418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 205/407] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:29 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:29.829669 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:29.830378 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:29.836643 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:29.837496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:29.837956 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:29.838652 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:29.839111 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:29.839571 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:29.967808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:29.975344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96a7a600-a8ec-45f0-a8b4-6980d5226052 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1547 microversion: 2.1 time: 0.149938 Aug 26 12:17:29.975899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 203/408] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:29 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:29.996281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:29.996878 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:30.002868 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.003389 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.003821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.004511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.004982 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.005415 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.134093 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:30.141687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ee0d8316-3125-4c49-ad35-9c28080b09fd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1547 microversion: 2.1 time: 0.149651 Aug 26 12:17:30.142253 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 206/409] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:29 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:30.161191 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:30.166238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:30.167078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Searching by: {'deleted': False, 'project_id': '1f876d0f217a485392ddcbd79134f609'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 26 12:17:30.173563 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.174027 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.174451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.175551 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.176002 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.176418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.267398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 26 12:17:30.358166 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3210c361-14ba-4f83-a8a3-08a1621fa964 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200611 Aug 26 12:17:30.358656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 204/410] 10.222.0.61 () {58 vars in 1125 bytes} [Fri Aug 26 12:17:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:30.370922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:30.371561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:30.377439 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.377911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.378343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.379027 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.379527 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.379946 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.506769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:30.514572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d58d358-8342-46f3-83f2-80dbb547836d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1547 microversion: 2.1 time: 0.148209 Aug 26 12:17:30.515134 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 207/411] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:30 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:30.841642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:30.842373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:30.849744 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.850219 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.850648 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.851374 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:30.851823 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:30.852876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:30.983498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:30.991427 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6d10f6b-dc9e-4d09-8c89-871eacbbbd3b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1318 microversion: 2.1 time: 0.153773 Aug 26 12:17:30.991996 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 205/412] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:30 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:32.015307 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:32.015927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:32.022176 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:32.022849 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:32.023310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:32.024036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:32.024786 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:32.025260 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:32.036430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:32.038679 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:32.045663 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:32.046143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:32.046574 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:32.047285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:32.047733 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:32.048151 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:32.160166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:32.169361 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4451f038-af19-462a-b6f8-a6ce5cce68d5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1507 microversion: 2.1 time: 0.160279 Aug 26 12:17:32.169933 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 208/413] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:32 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:32.327470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64607bbc-3b6b-42ca-8af3-5479d08f0fb8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294843 Aug 26 12:17:32.328096 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 206/414] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:17:32 2022] POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:17:45.202321 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:45.202921 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:45.205783 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=69 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:45.206413 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=99 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:45.213285 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:45.213971 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:45.214479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:45.215177 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:45.215648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:45.216301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:45.350997 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:45.359776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a0243f5f-adc6-4120-bb6a-505134d6a3ed tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1593 microversion: 2.1 time: 0.161586 Aug 26 12:17:45.360340 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 209/415] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:45 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:47.277936 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:47.279319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=83 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:47.286511 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:17:47.290692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3133b9c4-1b58-4d1d-900b-df89c38a9efe req-043ea003-41cd-497a-b6de-22aeb258195b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636be5ae-16a1-4ef8-9d5e-649c32df46c2", "tag": "23eb6509-4bf3-4d20-8514-4a082338c7ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:47.302333 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3133b9c4-1b58-4d1d-900b-df89c38a9efe req-043ea003-41cd-497a-b6de-22aeb258195b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:47.302913 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3133b9c4-1b58-4d1d-900b-df89c38a9efe req-043ea003-41cd-497a-b6de-22aeb258195b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:47.303364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3133b9c4-1b58-4d1d-900b-df89c38a9efe req-043ea003-41cd-497a-b6de-22aeb258195b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:47.320960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3133b9c4-1b58-4d1d-900b-df89c38a9efe req-043ea003-41cd-497a-b6de-22aeb258195b service nova] Creating event network-changed:23eb6509-4bf3-4d20-8514-4a082338c7ce for instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 on hv-cinder-84630 Aug 26 12:17:47.326874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3133b9c4-1b58-4d1d-900b-df89c38a9efe req-043ea003-41cd-497a-b6de-22aeb258195b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050312 Aug 26 12:17:47.327816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 207/416] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:48.304835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2004682744"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:48.305362 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:48.312500 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:48.312970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:48.313419 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:48.314101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:48.314546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:48.314962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:48.440544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.network.security_group_api [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Adding security group 65dc0306-80d7-4bd7-a35d-0f40bfb4b0ad to port 23eb6509-4bf3-4d20-8514-4a082338c7ce Aug 26 12:17:48.794979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-198819da-e523-4e2b-8390-ce1886eda239 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/action" status: 202 len: 0 microversion: 2.1 time: 0.493992 Aug 26 12:17:48.795970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 210/417] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:17:48 2022] POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:17:48.805169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:48.805905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:48.812530 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:48.813014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:48.813450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:48.814149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:48.814599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:48.815022 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:48.972066 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:48.981057 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dbe746f6-de1b-43c7-be98-2cfc5177b4ef tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1759 microversion: 2.1 time: 0.180791 Aug 26 12:17:48.981636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 208/418] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:48 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:49.341488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-b4af3b6d-8bcd-436b-85d0-6e5f48e0fab4 req-7f4143f3-e7a5-4c5f-9a11-99a76262fa93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636be5ae-16a1-4ef8-9d5e-649c32df46c2", "tag": "23eb6509-4bf3-4d20-8514-4a082338c7ce"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:49.350764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b4af3b6d-8bcd-436b-85d0-6e5f48e0fab4 req-7f4143f3-e7a5-4c5f-9a11-99a76262fa93 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:49.351259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b4af3b6d-8bcd-436b-85d0-6e5f48e0fab4 req-7f4143f3-e7a5-4c5f-9a11-99a76262fa93 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:49.351690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b4af3b6d-8bcd-436b-85d0-6e5f48e0fab4 req-7f4143f3-e7a5-4c5f-9a11-99a76262fa93 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:49.364335 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-b4af3b6d-8bcd-436b-85d0-6e5f48e0fab4 req-7f4143f3-e7a5-4c5f-9a11-99a76262fa93 service nova] Creating event network-changed:23eb6509-4bf3-4d20-8514-4a082338c7ce for instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 on hv-cinder-84630 Aug 26 12:17:49.370751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-b4af3b6d-8bcd-436b-85d0-6e5f48e0fab4 req-7f4143f3-e7a5-4c5f-9a11-99a76262fa93 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Aug 26 12:17:49.371761 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 211/419] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:50.252508 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15ecf9c9-31f0-4031-ae13-fd5daa57d65f"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:50.254793 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:50.261839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:50.262328 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:50.262740 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:50.263456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:50.263900 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:50.264316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:50.511238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98aa327d-6cb2-457a-8eb4-e1d1aca1c864 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262546 Aug 26 12:17:50.511801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 209/420] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:17:50 2022] POST /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:17:50.561518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "555266cc-7ffb-4387-b80a-242582460e40", "device": "/dev/sdb"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:50.564801 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:50.573406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:50.573897 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:50.574327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:50.575018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:50.575487 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:50.575906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:50.830371 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f027bb18-7fc8-4055-a9d3-26ca1fa996f4 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "POST /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274380 Aug 26 12:17:50.831413 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 212/421] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:17:50 2022] POST /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:17:53.180223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:53.180806 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:53.187661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:53.188140 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:53.188573 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:53.189266 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:53.189715 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:53.190133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:53.314190 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lazy-loading 'services' on Instance uuid c6221ce4-7d73-44fa-a573-5d3b3146b9d8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:17:53.430056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e72f7013-ab1e-483b-92f0-62b0d09f20e7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-volume_attachments/9c614b46-d5ee-4b51-ba9f-07c5aa2c64c8" status: 202 len: 0 microversion: 2.1 time: 0.254650 Aug 26 12:17:53.430634 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 210/422] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:17:53 2022] DELETE /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-volume_attachments/9c614b46-d5ee-4b51-ba9f-07c5aa2c64c8 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:17:58.033153 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:17:58.035416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:58.043018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:58.043610 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:58.044051 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:58.044754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:58.045208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:58.045633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:58.069084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lazy-loading 'flavor' on Instance uuid 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:17:58.224648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-87c776c3-a74b-4f8f-802c-27e614b5c733 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/action" status: 200 len: 32 microversion: 2.1 time: 0.195828 Aug 26 12:17:58.225181 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 213/423] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:17:58 2022] POST /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:17:58.236316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:58.237384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:58.244725 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:58.245321 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:58.245758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:58.247270 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:58.247709 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:58.248446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:58.382161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:58.390865 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e55b2f1-5e8b-4257-9e42-fe1d5d662758 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.159397 Aug 26 12:17:58.391468 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 211/424] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:58 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:17:59.413686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:17:59.414372 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:17:59.421330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:59.421565 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:59.422440 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:59.422889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:17:59.423341 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:17:59.423742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:17:59.561595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:17:59.569771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c53ef784-429d-4bdd-9448-2a175570234f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.160802 Aug 26 12:17:59.570335 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 214/425] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:17:59 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:00.589988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:00.590772 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:00.597170 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:00.597645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:00.598083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:00.598765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:00.599230 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:00.599655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:00.727180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:00.735398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5eb6d397-2e52-4650-a05c-32dde2e992c6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.149426 Aug 26 12:18:00.735964 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 212/426] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:00 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:01.757619 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:01.758245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:01.765873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:01.766699 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:01.767358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:01.768056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:01.768528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:01.768947 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:01.899617 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:01.908406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-27a67454-5d5d-4292-a4a8-7a64530eb28d tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.155101 Aug 26 12:18:01.909062 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 215/427] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:01 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:02.929633 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:02.930239 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:02.936632 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:02.937110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:02.937541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:02.938225 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:02.938677 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:02.939095 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:03.066783 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:03.075053 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26ba6938-729b-4499-bb1d-8dff1df408f3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.149288 Aug 26 12:18:03.075642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 213/428] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:02 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:04.097473 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:04.098087 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:04.105031 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:04.105607 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:04.106043 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:04.106731 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:04.107181 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:04.107624 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:04.236149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:04.244898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96132efc-8c55-4133-95b0-20b053add108 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.151205 Aug 26 12:18:04.246195 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 216/429] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:04 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:05.118979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-293a746b-b627-4f9f-b534-7b7141e05be5 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:05.125880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-293a746b-b627-4f9f-b534-7b7141e05be5 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:05.126344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-293a746b-b627-4f9f-b534-7b7141e05be5 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:05.126779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-293a746b-b627-4f9f-b534-7b7141e05be5 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:05.148838 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-293a746b-b627-4f9f-b534-7b7141e05be5 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Going to try to stop instance {{(pid=120698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 26 12:18:05.188949 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-293a746b-b627-4f9f-b534-7b7141e05be5 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action" status: 202 len: 0 microversion: 2.1 time: 0.073834 Aug 26 12:18:05.189547 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 214/430] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:18:05 2022] POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:18:05.197795 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:05.199120 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:05.205467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:05.206038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:05.206465 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:05.207231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:05.207706 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:05.208132 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:05.267014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:05.267734 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:05.273937 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:05.274411 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:05.274840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:05.275564 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:05.276031 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:05.276454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:05.380019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:05.387814 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3e955c9b-1ff2-4ba0-8ee5-9d45de49a2f6 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.193920 Aug 26 12:18:05.388388 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 217/431] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:05 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:05.422657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:05.430705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3353c684-fc8d-459c-a719-2aa55de30ab8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.167924 Aug 26 12:18:05.431435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 215/432] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:05 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:06.409355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:06.409955 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:06.416269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:06.416881 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:06.417316 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:06.418004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:06.418454 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:06.418875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:06.452384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:06.452991 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:06.459922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:06.460405 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:06.460836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:06.461557 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:06.462007 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:06.462503 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:06.599718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:06.607291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f49907d8-bca4-4bef-b6b1-5bb450c272b2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.201805 Aug 26 12:18:06.607861 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 218/433] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:06 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:06.628779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:06.637502 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4713860-f898-4242-bfbb-cacc4ee9f866 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.189515 Aug 26 12:18:06.638046 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 216/434] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:06 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:07.629818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:07.630574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:07.637784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:07.638268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:07.638924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:07.639796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:07.640263 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:07.640686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:07.658706 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:07.659549 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:07.666094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:07.666616 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:07.667087 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:07.667818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:07.668262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:07.668674 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:07.851655 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:07.859754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-76eb2f92-2c5b-41f9-97a0-2dcdc4b195ad tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.233737 Aug 26 12:18:07.860336 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 219/435] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:07 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:07.868075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:07.876678 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c60ad43f-51ae-4212-943d-db9cc19c3c29 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.222192 Aug 26 12:18:07.877248 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 217/436] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:07 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:08.881220 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:08.881828 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:08.888375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:08.888864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:08.889296 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:08.889981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:08.890432 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:08.890851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:08.897774 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:08.898369 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:08.905488 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:08.905963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:08.906389 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:08.907068 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:08.907536 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:08.907947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:09.101678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:09.109841 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:09.110048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4bda0748-3379-4d55-8b3a-a17588807e1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.232650 Aug 26 12:18:09.110673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 220/437] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:08 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:09.119095 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d417614e-64ed-402b-9c2c-5af9cf3baf5e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.225118 Aug 26 12:18:09.120278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 218/438] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:08 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:10.133005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:10.133626 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:10.140676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:10.141052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:10.141479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:10.141606 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:10.141703 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:10.142275 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:10.142731 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:10.143159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:10.147871 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:10.148344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:10.148769 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:10.149441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:10.149883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:10.150306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:10.336140 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:10.340386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:10.344068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bbb3dbed-451c-4b9f-80b5-51da1873d65e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.214895 Aug 26 12:18:10.344650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 221/439] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:10 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:10.348465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4d1bf89-36e9-4df6-8fb7-24db684c4571 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.211179 Aug 26 12:18:10.349020 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 219/440] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:10 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:11.365529 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:11.366143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:11.368927 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:11.369527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:11.372839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:11.373328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:11.373763 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:11.374469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:11.374925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:11.375382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:11.375891 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:11.376385 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:11.376811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:11.377485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:11.377952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:11.378446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:11.567979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:11.571748 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:11.576495 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-09a0b0e3-696a-4cdf-84fa-8d5a660ef29b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.215040 Aug 26 12:18:11.577064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 222/441] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:11 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:11.580809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c1ac9050-d9bb-4587-b3aa-0beb57995e70 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.215912 Aug 26 12:18:11.581361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 220/442] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:11 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:12.597989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:12.598649 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:12.601636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:12.602248 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:12.605651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:12.606135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:12.606561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:12.607268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:12.607719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:12.608139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:12.609518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:12.610007 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:12.610463 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:12.611130 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:12.611621 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:12.612049 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:12.612529 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:12.616784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:12.804123 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:12.807290 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:12.812351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f6c25315-fc07-4182-bb70-c707664ac3a9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.218052 Aug 26 12:18:12.812936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 223/443] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:12 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:12.815275 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d31c8a56-cf4a-4350-996c-df605c2c3672 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.217445 Aug 26 12:18:12.815822 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 221/444] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:12 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:13.833466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:13.834092 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:13.836118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:13.836730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:13.841432 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:13.841930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:13.842375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:13.843064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:13.843541 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:13.843696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:13.843961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:13.844179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:13.844609 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:13.845304 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:13.845752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:13.846171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:14.034256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:14.038386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:14.042331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ee43bdf2-6d99-4779-878e-2614d28729fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.212916 Aug 26 12:18:14.042903 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 224/445] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:13 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:14.046761 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e29d4c39-13fa-4b61-a08b-0b79907d984a tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.214442 Aug 26 12:18:14.047351 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 222/446] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:13 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:15.063335 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:15.063858 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:15.068133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:15.068784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:15.070435 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:15.070924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:15.071400 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:15.072100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:15.072554 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:15.073010 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:15.075048 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:15.075549 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:15.075976 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:15.076654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:15.077099 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:15.077514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:15.266900 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:15.270056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:15.275162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8257602f-13d0-4118-bd79-346eac38fb05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.210787 Aug 26 12:18:15.276408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 223/447] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:15 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:15.278404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-18c99df2-6167-45e6-95bc-3f897a3a5eef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.219037 Aug 26 12:18:15.278961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 225/448] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:15 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:16.297606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:16.298209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:16.299378 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:16.299991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:16.302330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=35 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:16.305312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:16.305799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:16.306220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:16.306896 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:16.307278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:16.307408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:16.307766 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:16.307873 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:16.308201 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:16.308896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:16.309348 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:16.309770 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:16.497412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:16.508386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-967d82a5-a984-492c-a8c7-72216b7a6c0f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.214621 Aug 26 12:18:16.509183 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 224/449] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:16 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:16.513198 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:16.521178 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1d68ca00-99e0-48ed-9732-4cfb381df53e tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.225558 Aug 26 12:18:16.522002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 226/450] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:16 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:17.530193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:17.530794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:17.533091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=37 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:17.538256 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:17.538735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:17.539168 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:17.539881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:17.540325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:17.540743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:17.542111 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:17.542725 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:17.548978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:17.549455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:17.549882 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:17.550596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:17.551056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:17.551517 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:17.740388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:17.749186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:17.751560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b941a6de-c39e-4b56-9115-6370935f4ebc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.225761 Aug 26 12:18:17.752226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 225/451] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:17 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:17.757160 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fa7e779f-e2a5-4b5b-b4f6-62cb0bd532ec tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.219147 Aug 26 12:18:17.757731 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 227/452] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:17 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:18.300902 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:18.301389 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:18.307982 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.308459 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.308885 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.309567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.310011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.310429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.332408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fce77fa0-6f58-4703-bda0-8ae2955c85b0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c/ips" status: 200 len: 148 microversion: 2.1 time: 0.035404 Aug 26 12:18:18.332954 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 226/453] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:18:18 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:18.345261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45f0938e-4c1f-4796-978a-0d5d05e1bf66"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:18.347695 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:18.353574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.354576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.355006 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.355715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.356170 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.356593 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.435050 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Invalid volume: volume 45f0938e-4c1f-4796-978a-0d5d05e1bf66 is already attached to instances: 92140aaa-db0d-49e1-9c47-c71a24aeeeec Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c/os-volume_attachments HTTP/1.1 Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 74 Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:18:18.436787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {"volumeAttachment": {"volumeId": "45f0938e-4c1f-4796-978a-0d5d05e1bf66"}} Aug 26 12:18:18.438323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Invalid volume: volume 45f0938e-4c1f-4796-978a-0d5d05e1bf66 is already attached to instances: 92140aaa-db0d-49e1-9c47-c71a24aeeeec Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'server_id': 'e6927fcc-8685-4602-9ac7-c09fcde9d05c', 'body': {'volumeAttachment': {'volumeId': '45f0938e-4c1f-4796-978a-0d5d05e1bf66'}}} Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 45f0938e-4c1f-4796-978a-0d5d05e1bf66 is already attached to instances: 92140aaa-db0d-49e1-9c47-c71a24aeeeec Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:18.439172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 45f0938e-4c1f-4796-978a-0d5d05e1bf66 is already attached to instances: 92140aaa-db0d-49e1-9c47-c71a24aeeeec Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:18.440616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 45f0938e-4c1f-4796-978a-0d5d05e1bf66 is already attached to instances: 92140aaa-db0d-49e1-9c47-c71a24aeeeec Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 400 to user: Invalid volume: volume 45f0938e-4c1f-4796-978a-0d5d05e1bf66 is already attached to instances: 92140aaa-db0d-49e1-9c47-c71a24aeeeec {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-82a4f2e5-9a34-4505-bc36-f8a750e3709a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097086 Aug 26 12:18:18.442061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 228/454] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:18:18 2022] POST /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:18:18.447712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:18.448262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:18.454090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.454566 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.454996 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.455699 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.456149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.456564 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.481053 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:18:18.562838 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41a89c5a-2071-4ce1-a015-6a8851c378bc tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 204 len: 0 microversion: 2.1 time: 0.118296 Aug 26 12:18:18.566816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 227/455] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:18:18 2022] DELETE /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:18:18.572059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:18.572789 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:18.580354 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.580948 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.581359 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.582047 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.582494 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.582911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.717715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:18.725314 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3e3f1f9d-b695-4085-94bc-ed21b22137a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1679 microversion: 2.1 time: 0.157449 Aug 26 12:18:18.725881 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 229/456] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:18 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:18.773879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:18.775107 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:18.779988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:18.780870 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:18.782308 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.782887 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.783452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.784500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.785417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.785829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.788525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.789312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.789757 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.790462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:18.790922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:18.791999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:18.992295 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:18.996012 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:19.000829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a8cd712-1873-4baf-a70e-9109b303f752 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.231238 Aug 26 12:18:19.001429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 228/457] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:18 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:19.004006 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ce80ffe8-6b7d-420a-a573-f2a886284293 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.229353 Aug 26 12:18:19.004556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 230/458] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:18 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:19.749246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:19.749850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:19.756132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:19.756602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:19.757025 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:19.757698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:19.758135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:19.758548 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:19.889844 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:19.897710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a33945e-7bad-48db-99bc-40b31404ccea tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1679 microversion: 2.1 time: 0.152972 Aug 26 12:18:19.898265 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 229/459] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:19 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:20.022014 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:20.022557 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:20.026090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:20.026950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:20.029690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.030199 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.030692 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:20.031455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.031917 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.032368 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:20.033608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.034085 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.034535 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:20.035416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.035757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.036178 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:20.222715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:20.225858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:20.231500 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-181007a9-ef9d-499e-a220-198456908375 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.213439 Aug 26 12:18:20.232162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 231/460] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:20 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:20.234186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a71b00c5-6e79-43c8-929b-2a5721278698 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.212530 Aug 26 12:18:20.234741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 230/461] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:20 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:20.908842 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:20.909334 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:20.915177 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.915683 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.916115 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:20.916872 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.917322 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.917744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:20.918011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:20.918649 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:20.925080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.925554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.925982 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:20.926665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:20.927110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:20.927555 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:21.043710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lazy-loading 'services' on Instance uuid 564aca9b-b30b-43f8-80b6-8f8cacadb414 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:21.057982 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:21.065942 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5836cfad-7421-427f-899b-a20e458c2ea0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1679 microversion: 2.1 time: 0.151967 Aug 26 12:18:21.066650 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 231/462] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:20 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:21.162521 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9884f98e-48db-4e8e-b348-4f8b28418f1c tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "DELETE /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414/os-volume_attachments/555266cc-7ffb-4387-b80a-242582460e40" status: 202 len: 0 microversion: 2.1 time: 0.257392 Aug 26 12:18:21.163135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 232/463] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:18:20 2022] DELETE /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414/os-volume_attachments/555266cc-7ffb-4387-b80a-242582460e40 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:18:21.252838 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:21.253445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:21.256326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:21.256983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:21.259498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:21.260002 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:21.260456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:21.261279 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:21.261737 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:21.262160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:21.263112 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:21.263622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:21.264054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:21.264733 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:21.265177 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:21.265591 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:21.462340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:21.473885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:21.476125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb7f6d01-427b-45d0-a63b-217cd8dbb83e tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1735 microversion: 2.1 time: 0.227035 Aug 26 12:18:21.477185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 232/464] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:21 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:21.496162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8d851d71-6852-4bde-be80-9cb8312e68b9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.243975 Aug 26 12:18:21.496816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 233/465] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:21 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:22.088807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:22.089494 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:22.096238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.096800 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.097306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.098076 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.098604 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.099110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.165302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:22.174557 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab87d002-b79e-40ca-a5ff-2d46389076a0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1612 microversion: 2.1 time: 0.089988 Aug 26 12:18:22.175231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 233/466] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:22 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:22.273663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3f6ff8fc-e02a-4444-b5d0-7a06e74d3be1 req-07494e21-8973-4ead-ad7c-08fd5d7b464a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6927fcc-8685-4602-9ac7-c09fcde9d05c", "name": "network-vif-deleted", "tag": "8f66372a-f26e-42ef-834e-6e88cd004c10"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:22.303099 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3f6ff8fc-e02a-4444-b5d0-7a06e74d3be1 req-07494e21-8973-4ead-ad7c-08fd5d7b464a service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.304231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3f6ff8fc-e02a-4444-b5d0-7a06e74d3be1 req-07494e21-8973-4ead-ad7c-08fd5d7b464a service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.304632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3f6ff8fc-e02a-4444-b5d0-7a06e74d3be1 req-07494e21-8973-4ead-ad7c-08fd5d7b464a service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.317183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3f6ff8fc-e02a-4444-b5d0-7a06e74d3be1 req-07494e21-8973-4ead-ad7c-08fd5d7b464a service nova] Creating event network-vif-deleted:8f66372a-f26e-42ef-834e-6e88cd004c10 for instance e6927fcc-8685-4602-9ac7-c09fcde9d05c on hv-cinder-84630 Aug 26 12:18:22.321971 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3f6ff8fc-e02a-4444-b5d0-7a06e74d3be1 req-07494e21-8973-4ead-ad7c-08fd5d7b464a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053038 Aug 26 12:18:22.323257 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 234/467] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:22.498988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:22.499645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:22.506478 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.506962 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.507421 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.508111 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.508602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.509015 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.517731 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:22.522852 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:22.545615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.547675 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.548245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.550449 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.551016 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.552257 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.749236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:22.759358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0dd63f55-bb72-40d0-8007-2b3610afc54f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1715 microversion: 2.1 time: 0.264566 Aug 26 12:18:22.761722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 234/468] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:22 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1715 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:22.809488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:22.818969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-706660af-6c1a-4ec9-ace6-2bcd6fd2ae0f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1676 microversion: 2.1 time: 0.305360 Aug 26 12:18:22.820018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 235/469] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:22 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1676 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:22.902850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:22.903370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:22.909824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.910306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.910736 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:22.911993 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:22.911993 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:22.912315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.002657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] HTTP exception thrown: Cannot 'detach_volume' instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 while it is in vm_state rescued Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Request method failure captured: Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments/15ecf9c9-31f0-4031-ae13-fd5daa57d65f HTTP/1.1 Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkWNTQVOh-73fS3fVnMdoZwjJF4hSzPJugXKBzjT0CDmZY_79b-Stos2SO622p9EhnU1TyD3iAl7uru5C1Pm0w3rY4VqtDvxPc9Q-90zV55zke8UuNi33P0RSwSAcMEYglTjKX-6zNL-HS6Madg6ekec-OK3k7beuOCXJOBPHp7Nts Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:18:23.004465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/984b6ea268f04e8989283e6397b68370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_984b6ea268f04e8989283e6397b68370", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: a02508c20bd547708638c1875101da6f Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:18:23.005768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Cannot 'detach_volume' instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 while it is in vm_state rescued Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'server_id': '75c5a14c-01ca-4ad0-94f0-cc7edcd90c48', 'id': '15ecf9c9-31f0-4031-ae13-fd5daa57d65f'} Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:18:23.006456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 while it is in vm_state rescued Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 while it is in vm_state rescued Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:23.008311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Returning 409 to user: Cannot 'detach_volume' instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 while it is in vm_state rescued {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:18:23.009263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0661799-c5f0-468d-987b-669b402f26eb tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "DELETE /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments/15ecf9c9-31f0-4031-ae13-fd5daa57d65f" status: 409 len: 152 microversion: 2.1 time: 0.108060 Aug 26 12:18:23.011124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 235/470] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:18:22 2022] DELETE /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments/15ecf9c9-31f0-4031-ae13-fd5daa57d65f => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 26 12:18:23.015754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:23.016281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:23.022464 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.023148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.023637 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.024333 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.024777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.025389 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.094973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-73990e56-69f5-44a2-a28b-c3356b1deb21 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "POST /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/action" status: 202 len: 0 microversion: 2.1 time: 0.083595 Aug 26 12:18:23.095822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 236/471] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:18:23 2022] POST /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:18:23.105081 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:23.106404 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:23.113795 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.114504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.115566 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.116440 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.117063 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.117638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.139092 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:23.198234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:23.199264 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:23.215994 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.216983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.217577 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.218468 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.219934 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.220532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.257433 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.258100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.258684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.259318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'fault' on Instance uuid e6927fcc-8685-4602-9ac7-c09fcde9d05c {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:23.329445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:23.343708 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-13e316d3-eeee-4db1-bce2-7b438ff98f88 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1331 microversion: 2.1 time: 0.148652 Aug 26 12:18:23.346045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 237/472] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:23 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:23.370177 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:23.384543 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01749eca-2577-41fc-b6d6-34a7e97fa60b tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1723 microversion: 2.1 time: 0.284440 Aug 26 12:18:23.404125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 236/473] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:23 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:23.422495 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:23.423696 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:23.430488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.431231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.432508 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.433398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.434030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.434605 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.480834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:23.489901 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:18:23.599005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5424948a-515b-4559-b29e-edbad7c1086f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "DELETE /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 204 len: 0 microversion: 2.1 time: 0.182526 Aug 26 12:18:23.600905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 238/474] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:18:23 2022] DELETE /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:18:23.609745 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:23.611197 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:23.620154 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.622052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.622695 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.623638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.625008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.625837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.795745 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:23.804849 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8ecb5a8-6f39-4b93-b93a-d97c2045ea66 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1513 microversion: 2.1 time: 0.199465 Aug 26 12:18:23.805546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 237/475] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:23 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:23.841926 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:23.842636 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:23.848808 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.849574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.849719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.850419 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:23.850868 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:23.851312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:23.983707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:23.991913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0cfee1fa-121a-47de-adbb-2bf65016196d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1653 microversion: 2.1 time: 0.154405 Aug 26 12:18:23.992481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 239/476] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:23 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:24.013622 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9445f28-76c1-4c2d-9fc0-a1912ddd4a66 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:24.020310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9445f28-76c1-4c2d-9fc0-a1912ddd4a66 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.020794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9445f28-76c1-4c2d-9fc0-a1912ddd4a66 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.021223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9445f28-76c1-4c2d-9fc0-a1912ddd4a66 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.043021 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9445f28-76c1-4c2d-9fc0-a1912ddd4a66 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Going to try to start instance {{(pid=120698) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 26 12:18:24.083793 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9445f28-76c1-4c2d-9fc0-a1912ddd4a66 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action" status: 202 len: 0 microversion: 2.1 time: 0.074705 Aug 26 12:18:24.084406 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 238/477] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:18:24 2022] POST /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 12:18:24.093105 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:24.093714 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:24.099799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.100226 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.100652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.101337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.101782 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.102197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.233151 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:24.241369 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cc8fa544-faff-45ac-848b-dff48a0eb622 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1662 microversion: 2.1 time: 0.152196 Aug 26 12:18:24.242001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 240/478] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:24 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:24.367324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:24.368015 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:24.374059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.374532 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.374955 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.375667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.376105 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.376516 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.407587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.408059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.408480 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.408912 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'fault' on Instance uuid e6927fcc-8685-4602-9ac7-c09fcde9d05c {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:24.411853 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:24.412420 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:24.423872 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.424512 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.425201 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.426115 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.426603 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.427030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.452380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:24.460837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f72f802-c8e2-46ac-a3cf-b3aa8deee37c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1331 microversion: 2.1 time: 0.098353 Aug 26 12:18:24.461422 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 239/479] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:24 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:24.566496 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:24.575244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e3b9a2ba-4682-4987-881c-d599dbb5ba46 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1723 microversion: 2.1 time: 0.167361 Aug 26 12:18:24.575811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 241/480] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:24 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:24.828183 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:24.828710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:24.834597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.835062 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.835531 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.836208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:24.836654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:24.837067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:24.965411 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:24.972998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9e0aea0f-66eb-4e0d-a21d-c6bd010720a1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1513 microversion: 2.1 time: 0.148777 Aug 26 12:18:24.973556 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 240/481] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:24 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:25.262857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:25.263652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:25.269684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:25.270249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:25.270757 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:25.271559 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:25.272091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:25.272589 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:25.402792 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:25.410450 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-083f4e91-b2ab-4253-b001-01e9f71bb7ac tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1662 microversion: 2.1 time: 0.152482 Aug 26 12:18:25.411010 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 242/482] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:25 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:25.482010 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:25.482611 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:25.488935 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:25.489414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:25.490094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:25.490883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:25.491367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:25.491787 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:25.523987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:25.524465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:25.524895 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:25.525348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'fault' on Instance uuid e6927fcc-8685-4602-9ac7-c09fcde9d05c {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:25.597249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:25.599331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:25.612102 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:25.621695 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e69e9360-0b01-4ae5-9649-9b8351cc27b5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 200 len: 1331 microversion: 2.1 time: 0.143642 Aug 26 12:18:25.622279 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 241/483] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:25 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 1331 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:25.637682 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:25.638426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:25.639031 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:25.640019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:25.640636 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:25.641806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:25.994925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:25.995659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:26.001477 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:26.002171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:26.002605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:26.003313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:26.003757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:26.004171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:26.169127 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:26.177212 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-df15744a-aac5-44f8-8999-a58ef7c8d970 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1723 microversion: 2.1 time: 0.583927 Aug 26 12:18:26.177860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 243/484] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:25 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1723 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:26.269397 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:26.277362 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09e43ce9-8149-477a-b181-f95114743a6d tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1513 microversion: 2.1 time: 0.286952 Aug 26 12:18:26.278028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 242/485] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:25 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1513 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:26.432618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:26.433672 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:26.440462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:26.441089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:26.441530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:26.442220 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:26.442673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:26.443089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:26.553410 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a1304652-7d3f-4da3-b972-1d0bf7ad9b59 req-a8a98756-b501-45d1-959f-13cdd3f5fbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "564aca9b-b30b-43f8-80b6-8f8cacadb414", "name": "network-vif-deleted", "tag": "608668a6-1d28-49d2-ac5e-911edbc56091"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:26.564115 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a1304652-7d3f-4da3-b972-1d0bf7ad9b59 req-a8a98756-b501-45d1-959f-13cdd3f5fbf3 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:26.564679 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a1304652-7d3f-4da3-b972-1d0bf7ad9b59 req-a8a98756-b501-45d1-959f-13cdd3f5fbf3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:26.565171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a1304652-7d3f-4da3-b972-1d0bf7ad9b59 req-a8a98756-b501-45d1-959f-13cdd3f5fbf3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:26.576538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a1304652-7d3f-4da3-b972-1d0bf7ad9b59 req-a8a98756-b501-45d1-959f-13cdd3f5fbf3 service nova] Creating event network-vif-deleted:608668a6-1d28-49d2-ac5e-911edbc56091 for instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 on hv-cinder-84630 Aug 26 12:18:26.581383 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a1304652-7d3f-4da3-b972-1d0bf7ad9b59 req-a8a98756-b501-45d1-959f-13cdd3f5fbf3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031608 Aug 26 12:18:26.582338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 243/486] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:18:26.618439 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:26.626639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-77bc934a-f3e9-45ed-abef-613dfd5dcefb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1662 microversion: 2.1 time: 0.199226 Aug 26 12:18:26.627215 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 244/487] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:26 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1662 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:26.642261 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:26.642983 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:26.649101 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:26.649610 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:26.650036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:26.650798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:26.651461 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:26.652123 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:26.667472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c HTTP/1.1 Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:18:26.668986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:18:26.670484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'e6927fcc-8685-4602-9ac7-c09fcde9d05c'} Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:18:26.671416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:18:26.672894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:18:26.674448 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:18:26.674448 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b8e1896-d5d8-496b-9211-72816a9afb1b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 404 len: 111 microversion: 2.1 time: 0.032205 Aug 26 12:18:26.674448 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 244/488] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:26 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:18:26.678918 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8dd13c0e-4216-483a-ba61-683f9f0ca3c2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '.version_select at 0x7ffa97a085e0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:26.698809 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8dd13c0e-4216-483a-ba61-683f9f0ca3c2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570421095" status: 202 len: 0 microversion: 2.1 time: 0.023602 Aug 26 12:18:26.699406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 245/489] 10.222.0.61 () {58 vars in 1221 bytes} [Fri Aug 26 12:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570421095 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:18:27.197959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:27.198715 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:27.205138 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.205629 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.206062 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.207989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.208654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.209310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.301727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:27.302870 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:27.311530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.312016 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.312830 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.313794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.314407 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.314880 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.403525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:27.412317 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-de2bb83a-9e05-4fd4-b799-661f3effeb83 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1303 microversion: 2.1 time: 0.116792 Aug 26 12:18:27.418747 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 246/490] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:27 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:27.439003 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:27.443907 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:27.444398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:27.452113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a642ab0c-7c2f-4fc1-9bf7-ffb3e182ce02 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1723 microversion: 2.1 time: 0.257110 Aug 26 12:18:27.453208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.453875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.454310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.455061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.456143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.456582 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.466174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 245/491] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:27 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:27.540509 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'services' on Instance uuid 92140aaa-db0d-49e1-9c47-c71a24aeeeec {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:27.611427 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-06c32d49-7398-451b-8d59-fdf047c1a316 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments/45f0938e-4c1f-4796-978a-0d5d05e1bf66" status: 202 len: 0 microversion: 2.1 time: 0.171273 Aug 26 12:18:27.612001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 247/492] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:18:27 2022] DELETE /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments/45f0938e-4c1f-4796-978a-0d5d05e1bf66 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 12:18:27.622296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:27.624801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:27.631240 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.631726 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.632156 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.632840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.633284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.633700 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.648382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:27.649067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:27.655730 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.656209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.656636 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.657315 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:27.657763 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:27.658176 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:27.663491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d56d172d-530d-4eaa-874f-7fb324b24e65 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046843 Aug 26 12:18:27.664076 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 246/493] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:18:27 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:27.792897 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:27.800441 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f9523f9d-6985-4ba9-aca8-f811328b924d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1662 microversion: 2.1 time: 0.156195 Aug 26 12:18:27.801000 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 248/494] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:27 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:28.435293 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:28.435896 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:28.441749 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.442572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.443004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.443702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.444144 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.444555 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.473616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:28.474221 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:28.477179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.477719 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.478144 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.478616 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lazy-loading 'fault' on Instance uuid 564aca9b-b30b-43f8-80b6-8f8cacadb414 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:28.480621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.481108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.481543 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.482276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.482737 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.483156 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.527294 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:28.536243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-392561d9-623c-426b-9921-bd55194100e2 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1308 microversion: 2.1 time: 0.105309 Aug 26 12:18:28.536816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 247/495] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:28 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:28.632369 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:28.640543 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dc142e27-529b-4dac-9f0d-1a29b1e185a8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1729 microversion: 2.1 time: 0.170971 Aug 26 12:18:28.641110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 249/496] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:28 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:28.660598 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:28.661095 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:28.668036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.668502 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.668925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.669597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.670041 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.670453 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.676091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:28.678281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:28.684928 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.685647 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.686029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.686745 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.687176 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.687623 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.717364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-079b800a-81f7-4165-8f3b-3e5e5186090d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Aug 26 12:18:28.717936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 250/497] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:18:28 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:18:28.749223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d519d9e6-8120-4c48-ad76-946a6dc5a6a7 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092396 Aug 26 12:18:28.750113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 248/498] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:18:28 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:28.821668 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:28.822390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:28.828528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.829079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.829518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.830202 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:28.830652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:28.831077 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:28.959423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:28.967829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8348a294-81ac-45b2-9737-d4bcf317882a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1666 microversion: 2.1 time: 0.150010 Aug 26 12:18:28.968400 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 251/499] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:28 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:29.558310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:29.558918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:29.565280 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.565958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.566553 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.567486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.568082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.568641 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.602406 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.602882 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.604032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.604725 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lazy-loading 'fault' on Instance uuid 564aca9b-b30b-43f8-80b6-8f8cacadb414 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:29.647254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:29.654735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b957bd1d-4c8d-4bb8-b0f5-829967713ce6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 200 len: 1308 microversion: 2.1 time: 0.100950 Aug 26 12:18:29.655326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 249/500] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:29 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:29.730323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:29.732472 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:29.738960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.739482 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.740838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.741555 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.742056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.742676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.773695 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1ee0acac-4209-4125-b1f4-77819d4dd1e2 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047822 Aug 26 12:18:29.774266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 252/501] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:18:29 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:18:29.836273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:29.836810 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:29.843927 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.844413 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.844838 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.845523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.845974 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.846392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.873204 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:18:29.923072 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-4b8d13a8-71e5-4c75-a65d-d8e227bd7511 req-995403e0-6847-41fe-916a-ca3f83cb7dca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5a14c-01ca-4ad0-94f0-cc7edcd90c48", "tag": "2265e6e6-c3fa-4e50-bd81-1d0302423d65"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:29.928999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:29.941704 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4b8d13a8-71e5-4c75-a65d-d8e227bd7511 req-995403e0-6847-41fe-916a-ca3f83cb7dca service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.942484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4b8d13a8-71e5-4c75-a65d-d8e227bd7511 req-995403e0-6847-41fe-916a-ca3f83cb7dca service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.944145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4b8d13a8-71e5-4c75-a65d-d8e227bd7511 req-995403e0-6847-41fe-916a-ca3f83cb7dca service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.962413 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-4b8d13a8-71e5-4c75-a65d-d8e227bd7511 req-995403e0-6847-41fe-916a-ca3f83cb7dca service nova] Creating event network-changed:2265e6e6-c3fa-4e50-bd81-1d0302423d65 for instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 on hv-cinder-84630 Aug 26 12:18:29.962628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e815955-9993-41ea-b952-976e10ab9e06 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 204 len: 0 microversion: 2.1 time: 0.129846 Aug 26 12:18:29.963949 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 250/502] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:18:29 2022] DELETE /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:18:29.972544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-4b8d13a8-71e5-4c75-a65d-d8e227bd7511 req-995403e0-6847-41fe-916a-ca3f83cb7dca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053677 Aug 26 12:18:29.973286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 253/503] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:29.973544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:29.974354 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:29.981481 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.982038 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.982559 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:29.983422 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:29.983878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:29.984318 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:30.122106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:30.129726 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c5fb623-4fbb-416c-8309-a20ab2bdae5c tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1681 microversion: 2.1 time: 0.160942 Aug 26 12:18:30.130285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 251/504] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:29 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:30.676410 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:30.677100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: 564aca9b-b30b-43f8-80b6-8f8cacadb414] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:30.683172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:30.683687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:30.684119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:30.684811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:30.685262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:30.685683 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:30.700534 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] HTTP exception thrown: Instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 could not be found. Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Request method failure captured: Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 HTTP/1.1 Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLm_4xeHQGBTzMYSQ-5I_D3whEeESFM5VEiKn327e0k_v7v7WPU1vT1ma6nHrmI0sr9dPne99vccyj18_NelX7VyQrEmsdmrqRTIHEQgked8SZaJ8N4F9DMLC3fXceNnthfAdIphZ7seDS7x4NWHCLjUZHtzRzG0FekmvvJ_VR-Mn8c Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 2ab22ea009914891b1f594ed3d1e4ec3 Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1170467750 Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:18:30.702209 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2ab22ea009914891b1f594ed3d1e4ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2ab22ea009914891b1f594ed3d1e4ec3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2ab22ea009914891b1f594ed3d1e4ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2ab22ea009914891b1f594ed3d1e4ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotTestJSON-1170467750 Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2ab22ea009914891b1f594ed3d1e4ec3 Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1170467750 Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotTestJSON-1170467750-project Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: a7d0a1ee39274a0d90a2be9fbc26a58b Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotTestJSON-1170467750-project Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 could not be found. Aug 26 12:18:30.703781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '564aca9b-b30b-43f8-80b6-8f8cacadb414'} Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 could not be found. Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:18:30.704632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 could not be found. Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 could not be found. Aug 26 12:18:30.705791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:30.706860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Returning 404 to user: Instance 564aca9b-b30b-43f8-80b6-8f8cacadb414 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:18:30.706860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-10671b7d-60c6-4212-b1cf-685a376a545b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414" status: 404 len: 111 microversion: 2.1 time: 0.031472 Aug 26 12:18:30.706860 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 254/505] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:30 2022] GET /compute/v2.1/servers/564aca9b-b30b-43f8-80b6-8f8cacadb414 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:18:31.151668 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:31.152268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:31.158639 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:31.159107 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:31.159561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:31.160233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:31.160675 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:31.161086 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:31.289376 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:31.297982 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f84c7e6-285d-4d5d-b0d8-c14b5f89d71f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1681 microversion: 2.1 time: 0.150298 Aug 26 12:18:31.298541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 252/506] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:31 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:31.517918 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:31.520029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:31.526979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:31.527489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:31.527923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:31.528605 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:31.529056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:31.529475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:31.533539 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:31.599609 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d8e742ed-c516-4ee4-9f8f-9b6d25ad2f8c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/action" status: 202 len: 0 microversion: 2.1 time: 0.085505 Aug 26 12:18:31.600212 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 255/507] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:18:31 2022] POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:18:31.608809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:31.609415 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:31.615560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:31.616032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:31.616463 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:31.617139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:31.617584 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:31.617998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:31.761263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:31.769730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37d39d61-bb5a-42ec-8903-352eec35d114 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1751 microversion: 2.1 time: 0.164565 Aug 26 12:18:31.770238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 253/508] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:31 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:31.989807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-1bcb568e-0346-4164-8ba0-f63a396acbe7 req-31caf643-9dd5-4377-b694-b1f94e56dd8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75c5a14c-01ca-4ad0-94f0-cc7edcd90c48", "tag": "2265e6e6-c3fa-4e50-bd81-1d0302423d65"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:32.000756 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1bcb568e-0346-4164-8ba0-f63a396acbe7 req-31caf643-9dd5-4377-b694-b1f94e56dd8b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:32.001232 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1bcb568e-0346-4164-8ba0-f63a396acbe7 req-31caf643-9dd5-4377-b694-b1f94e56dd8b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:32.001774 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1bcb568e-0346-4164-8ba0-f63a396acbe7 req-31caf643-9dd5-4377-b694-b1f94e56dd8b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:32.013121 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-1bcb568e-0346-4164-8ba0-f63a396acbe7 req-31caf643-9dd5-4377-b694-b1f94e56dd8b service nova] Creating event network-changed:2265e6e6-c3fa-4e50-bd81-1d0302423d65 for instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 on hv-cinder-84630 Aug 26 12:18:32.018137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-1bcb568e-0346-4164-8ba0-f63a396acbe7 req-31caf643-9dd5-4377-b694-b1f94e56dd8b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032539 Aug 26 12:18:32.018744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 256/509] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:32.324602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:32.325131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:32.331461 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:32.331930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:32.332357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:32.333029 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:32.333472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:32.333880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:32.461263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:32.468965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0085d00-0184-4db3-9ee4-9e7877b0de23 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1681 microversion: 2.1 time: 0.148973 Aug 26 12:18:32.469518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 254/510] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:32 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:32.793421 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:32.794117 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:32.800370 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:32.800854 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:32.801289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:32.801975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:32.802431 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:32.802851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:32.946758 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:32.955114 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2045b26d-7b3d-457a-9b87-8b5117846983 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1751 microversion: 2.1 time: 0.166972 Aug 26 12:18:32.955774 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 257/511] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:32 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:33.490803 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:33.491364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:33.498386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:33.498859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:33.499389 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:33.500069 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:33.500517 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:33.500931 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:33.625700 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:33.633212 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4dc3622e-56df-46fa-bbbf-7b2245acf9f9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1681 microversion: 2.1 time: 0.146601 Aug 26 12:18:33.633771 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 255/512] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:33 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:33.977157 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:33.977806 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:33.988498 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:34.000519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:34.000519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:34.000519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:34.000519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:34.000821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:34.218026 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:34.226639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-81915bdc-d27a-4bc7-90cb-1b3e2d66d2ba tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1751 microversion: 2.1 time: 0.253257 Aug 26 12:18:34.227511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 258/513] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:33 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1751 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:34.654708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:34.655403 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:34.663279 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:34.663771 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:34.664241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:34.664941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:34.665388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:34.665802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:34.814386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:34.822065 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09d245f9-6ce1-4026-8b09-7313160db5c4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1681 microversion: 2.1 time: 0.171977 Aug 26 12:18:34.822628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 256/514] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:34 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:35.248920 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:35.249539 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:35.255916 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:35.256400 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:35.257015 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:35.257880 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:35.258504 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:35.258932 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:35.412541 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:35.421330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2c4391f0-fbd0-4733-9676-e41a82e5a618 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.176333 Aug 26 12:18:35.421998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 259/515] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:35 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:35.677478 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cc7a09fb-8cbb-47f3-91dc-ab38a7939294 req-74e6f57c-ab55-4830-bff1-c051c6b2044b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92140aaa-db0d-49e1-9c47-c71a24aeeeec", "name": "network-vif-deleted", "tag": "143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:35.696283 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cc7a09fb-8cbb-47f3-91dc-ab38a7939294 req-74e6f57c-ab55-4830-bff1-c051c6b2044b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:35.698114 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cc7a09fb-8cbb-47f3-91dc-ab38a7939294 req-74e6f57c-ab55-4830-bff1-c051c6b2044b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:35.700125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cc7a09fb-8cbb-47f3-91dc-ab38a7939294 req-74e6f57c-ab55-4830-bff1-c051c6b2044b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:35.714041 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cc7a09fb-8cbb-47f3-91dc-ab38a7939294 req-74e6f57c-ab55-4830-bff1-c051c6b2044b service nova] Creating event network-vif-deleted:143f24b1-2dbf-47ea-abb4-b5bdbffb7bd8 for instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec on hv-cinder-84630 Aug 26 12:18:35.722307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cc7a09fb-8cbb-47f3-91dc-ab38a7939294 req-74e6f57c-ab55-4830-bff1-c051c6b2044b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047147 Aug 26 12:18:35.722917 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 257/516] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:35.844244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:35.845102 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:35.851068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:35.851817 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:35.852337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:35.853094 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:35.853739 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:35.854229 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:35.888266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:35.889189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:35.889685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:35.890191 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'fault' on Instance uuid 92140aaa-db0d-49e1-9c47-c71a24aeeeec {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:18:35.937664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:35.947483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-03417164-f1f2-4963-a8f2-308a385aec4d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 200 len: 1332 microversion: 2.1 time: 0.107407 Aug 26 12:18:35.948064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 260/517] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:35 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:36.448642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:36.449343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:36.462436 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:36.463048 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:36.463599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:36.465236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:36.465757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:36.466269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:36.617959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:36.626431 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d8e53cc-2f83-4a5e-9c89-942bccc521c1 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.182135 Aug 26 12:18:36.626995 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 258/518] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:36 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:36.970085 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:36.970688 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:36.977072 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:36.977546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:36.977974 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:36.978683 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:36.979132 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:36.979632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:36.992939 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec HTTP/1.1 Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:18:36.994538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:18:36.996680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '92140aaa-db0d-49e1-9c47-c71a24aeeeec'} Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:18:36.997553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:18:36.999152 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:18:37.000701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:18:37.000701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-09753c78-1e15-4a8d-925d-bdfd530b046e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 404 len: 111 microversion: 2.1 time: 0.030289 Aug 26 12:18:37.000701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 261/519] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:36 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:18:37.005391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43292dc0-6f23-4221-a897-894eb9732157 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '.version_select at 0x7ffa976788b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:37.027353 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43292dc0-6f23-4221-a897-894eb9732157 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609549922" status: 202 len: 0 microversion: 2.1 time: 0.025419 Aug 26 12:18:37.028101 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 259/520] 10.222.0.61 () {58 vars in 1221 bytes} [Fri Aug 26 12:18:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1609549922 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:18:37.647273 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:37.648884 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:37.653591 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf241051-bdeb-40e2-8149-4a317ab5be1e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: .version_select at 0x7ffa975d6790>, body: {"keypair": {"name": "tempest-keypair-1280716737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXMOxr7a2k0CVZnywgXGDKlOssHcsHbPIyaNmNHtcV9C6Eh26eJOQl0jip6yHDEwurnoKGEhT8JdrUnUGyC2mm4AdLdj7oMnNIzLYQl6Cq0yU5ZcDDntny5zQSAkPlL0A=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:37.654284 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:37.654764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:37.655192 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:37.655930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:37.656376 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:37.656876 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:37.670423 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-cf241051-bdeb-40e2-8149-4a317ab5be1e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:18:37.674199 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-cf241051-bdeb-40e2-8149-4a317ab5be1e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:18:37.683976 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:37.697887 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cf241051-bdeb-40e2-8149-4a317ab5be1e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048124 Aug 26 12:18:37.698696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 260/521] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:18:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:37.806968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:37.815704 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f6596239-1139-4f95-826a-cead6f4a09ff tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.172189 Aug 26 12:18:37.816267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 262/522] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:37 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:38.838177 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:38.838979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:38.847442 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:38.847999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:38.848495 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:38.849220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:38.849665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:38.850079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:38.954024 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1602508431", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7e62f88-9652-4f52-9fec-a02b6bfed4c3"}], "security_groups": [{"name": "tempest-securitygroup--1058306210"}], "key_name": "tempest-keypair-1280716737", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:38.997215 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:39.008534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22ac081e-8452-4769-b2ee-f1dd7a53e2f8 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.175541 Aug 26 12:18:39.009097 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 261/523] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:38 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:39.066454 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] validate_networks() for [('c7e62f88-9652-4f52-9fec-a02b6bfed4c3', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:18:39.434613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:18:39.435067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:18:39.435566 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:18:39.435972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:18:39.436381 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:18:39.445107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:39.445585 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:39.446017 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:39.446741 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:39.447290 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:39.447718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:39.464976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:18:39.468955 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:18:39.479650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:18:39.481951 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:18:39.493149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:39.529648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-89caad23-6b8c-489c-90ac-f79a038cb9f0 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579850 Aug 26 12:18:39.530411 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 263/524] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:18:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:18:39.540895 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2c110f0-3501-4aff-8da6-ff2c79a2cf57 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:39.541597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2c110f0-3501-4aff-8da6-ff2c79a2cf57 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:39.587689 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-638177230", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "networks": [{"uuid": "0eda80e6-13df-4bb1-9519-bd888a696b92"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:39.595747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2c110f0-3501-4aff-8da6-ff2c79a2cf57 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:39.603017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2c110f0-3501-4aff-8da6-ff2c79a2cf57 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1242 microversion: 2.1 time: 0.065906 Aug 26 12:18:39.604935 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 262/525] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:39 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:39.643443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] validate_networks() for [('0eda80e6-13df-4bb1-9519-bd888a696b92', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:18:40.016635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:18:40.017196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:18:40.017509 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:18:40.017912 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:18:40.018316 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:18:40.028653 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:40.029368 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:40.029798 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:40.030136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:40.030587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:40.030742 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:40.030950 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:40.031399 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:40.037708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:40.038381 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:40.038812 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:40.039525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:40.039982 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:40.040398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:40.049668 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Getting quotas for project 2ab22ea009914891b1f594ed3d1e4ec3. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:18:40.054317 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Getting quotas for user a7d0a1ee39274a0d90a2be9fbc26a58b and project 2ab22ea009914891b1f594ed3d1e4ec3. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:18:40.068747 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:18:40.071458 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:18:40.120936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d5c77b94-c324-4901-aa17-b9f1fa911076 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537864 Aug 26 12:18:40.122007 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 264/526] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:18:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:18:40.135325 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-96e73667-d90a-4eed-8709-1e6c34de80fb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:40.136822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-96e73667-d90a-4eed-8709-1e6c34de80fb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:40.231705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-96e73667-d90a-4eed-8709-1e6c34de80fb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:40.238990 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:40.241529 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-96e73667-d90a-4eed-8709-1e6c34de80fb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1218 microversion: 2.1 time: 0.109701 Aug 26 12:18:40.242356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 265/527] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:40 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:40.258145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16f38982-2760-40dd-af70-3161fc261ab4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.233010 Aug 26 12:18:40.259901 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 263/528] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:40 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:40.625139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:40.625743 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:40.632016 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:40.632485 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:40.632927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:40.633616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:40.634066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:40.634483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:40.694560 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:40.703016 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5f6b0b66-08da-431c-81b5-f3405305de91 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1294 microversion: 2.1 time: 0.081753 Aug 26 12:18:40.703609 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 266/529] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:40 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:41.263506 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:41.264127 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:41.270349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:41.270833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:41.271744 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:41.272572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:41.273031 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:41.273452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:41.281095 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:41.282203 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:41.298046 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:41.298958 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:41.299406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:41.300217 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:41.300927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:41.301359 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:41.347444 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:41.357654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75b15934-ab82-463c-a5c4-bb0641b78829 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1270 microversion: 2.1 time: 0.098427 Aug 26 12:18:41.358388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 264/530] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:41 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:41.699886 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:41.709330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e0ccee6c-5fdb-4665-9072-8f013398f9c6 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.433710 Aug 26 12:18:41.710596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 267/531] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:41 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:41.728653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:41.729260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:41.754003 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:41.754494 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:41.755019 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:41.757271 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:41.759373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:41.760003 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:41.943107 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:41.951724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-656ed19c-4241-40e2-bde6-2cde8cb1fa4b tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.227988 Aug 26 12:18:41.952412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 265/532] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:41 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:42.383774 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:42.384322 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:42.390544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:42.391026 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:42.391577 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:42.392184 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:42.392654 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:42.393047 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:42.455279 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:42.462942 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-065ab199-3b34-43f6-b545-e0774de4d3f1 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1276 microversion: 2.1 time: 0.083349 Aug 26 12:18:42.463548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 268/533] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:42 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:42.731819 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:42.732451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:42.739122 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:42.740142 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:42.744063 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:42.744063 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:42.744063 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:42.744063 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:42.891755 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:42.899971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1639bca-b486-44a9-bf65-3b50b200831f tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.172292 Aug 26 12:18:42.900533 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 266/534] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:42 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:42.974276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:42.975053 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:42.981599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:42.982090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:42.982572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:42.983332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:42.983789 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:42.984306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:42.999238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-26f688f4-f900-4cb0-bf7f-17207b863786 req-95204209-fd89-4c06-aaa9-e93244b211c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c064ae-bbc4-419e-adb2-2ad34d8a75de", "tag": "e5b60208-99c9-44f8-8594-9d98d325d3dd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:43.021959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-26f688f4-f900-4cb0-bf7f-17207b863786 req-95204209-fd89-4c06-aaa9-e93244b211c4 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:43.022437 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-26f688f4-f900-4cb0-bf7f-17207b863786 req-95204209-fd89-4c06-aaa9-e93244b211c4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:43.022866 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-26f688f4-f900-4cb0-bf7f-17207b863786 req-95204209-fd89-4c06-aaa9-e93244b211c4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:43.041082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-26f688f4-f900-4cb0-bf7f-17207b863786 req-95204209-fd89-4c06-aaa9-e93244b211c4 service nova] Creating event network-changed:e5b60208-99c9-44f8-8594-9d98d325d3dd for instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de on hv-cinder-84630 Aug 26 12:18:43.046979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-26f688f4-f900-4cb0-bf7f-17207b863786 req-95204209-fd89-4c06-aaa9-e93244b211c4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056512 Aug 26 12:18:43.047696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 267/535] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:18:43.144129 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:43.152777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f818c01c-7f9b-42ca-9153-9cbd9d172c51 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.182807 Aug 26 12:18:43.153523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 269/536] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:42 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:43.484836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:43.485675 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:43.492241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:43.492661 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:43.493098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:43.493782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:43.494232 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:43.494651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:43.626612 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:43.634237 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa6a1b9d-666d-4647-9f55-bc48f3e69078 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.154076 Aug 26 12:18:43.635180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 268/537] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:43 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:43.921877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:43.922558 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:43.929217 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:43.929758 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:43.930189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:43.930877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:43.931429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:43.931847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:44.076478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:44.084649 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-665594b0-f3c5-4c53-b45e-290e08a77fa3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.166725 Aug 26 12:18:44.085216 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 270/538] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:43 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:44.173894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:44.174491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:44.180761 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:44.181231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:44.181680 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:44.182352 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:44.183465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:44.183878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:44.316462 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:44.325004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-264b47f3-d16f-420b-ba46-d82aa2a118d5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.154950 Aug 26 12:18:44.325565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 269/539] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:44 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:44.655379 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:44.655991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:44.661890 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:44.662375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:44.662808 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:44.663550 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:44.664001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:44.664423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:44.800069 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:44.809514 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fe9f554f-5abb-46d6-825f-2e3002ab489f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.157994 Aug 26 12:18:44.810567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 271/540] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:44 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:45.075331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a902e425-3ca2-4d50-8843-0e7449671101 req-22898470-5915-4f4e-9099-84694674f2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc9b53aa-f689-40c0-9034-c6c8473b8d8b", "tag": "8ad9d30d-e059-412b-8e9b-20bb4e3d46bd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:45.086221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a902e425-3ca2-4d50-8843-0e7449671101 req-22898470-5915-4f4e-9099-84694674f2ad service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:45.086692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a902e425-3ca2-4d50-8843-0e7449671101 req-22898470-5915-4f4e-9099-84694674f2ad service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:45.087112 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a902e425-3ca2-4d50-8843-0e7449671101 req-22898470-5915-4f4e-9099-84694674f2ad service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:45.098486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a902e425-3ca2-4d50-8843-0e7449671101 req-22898470-5915-4f4e-9099-84694674f2ad service nova] Creating event network-changed:8ad9d30d-e059-412b-8e9b-20bb4e3d46bd for instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b on hv-cinder-84630 Aug 26 12:18:45.103814 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a902e425-3ca2-4d50-8843-0e7449671101 req-22898470-5915-4f4e-9099-84694674f2ad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032465 Aug 26 12:18:45.105440 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 270/541] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:45.106286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:45.106895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:45.113745 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:45.114226 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:45.114906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:45.115649 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:45.116096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:45.116510 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:45.264319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:45.272867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ab7cf51b-e50a-4985-85a1-035ec8fbecf3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.170881 Aug 26 12:18:45.273431 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 272/542] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:45 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:45.346486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:45.347297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:45.353921 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:45.355125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:45.355680 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:45.356478 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:45.357001 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:45.357485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:45.489679 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:45.498026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2f1daa3-8721-4e12-b635-c6188c4497ec tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.155783 Aug 26 12:18:45.498682 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 271/543] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:45 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:45.830125 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:45.830730 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:45.836741 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:45.837223 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:45.837653 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:45.838331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:45.838779 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:45.839195 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:45.963776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:45.971390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8fc4a310-3551-4c07-b595-dac4b12bbfdb tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.145102 Aug 26 12:18:45.971953 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 273/544] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:45 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:46.294441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:46.295037 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:46.300962 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:46.301434 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:46.301863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:46.302537 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:46.302979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:46.303417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:46.320511 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:46.449924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:46.458143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b028640-1c9e-4bce-854c-22ebb9e40c0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.168157 Aug 26 12:18:46.458740 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 272/545] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:46 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:46.519310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:46.519969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:46.526983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:46.527631 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:46.528073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:46.528757 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:46.529202 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:46.529618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:46.533574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:46.663050 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:46.670809 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8ae5b760-93ff-4c4e-a7dc-ff6d13a21c90 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.155343 Aug 26 12:18:46.671406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 274/546] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:46 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:46.992792 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:46.993404 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:47.000101 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:47.000582 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:47.001017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:47.001698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:47.002161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:47.002578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:47.133857 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:47.141388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e141034-4549-447d-8dff-e91ddcfa7360 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.152693 Aug 26 12:18:47.141941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 273/547] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:46 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:47.480741 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:47.481266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:47.487230 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:47.487727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:47.488158 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:47.488843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:47.489288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:47.489962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:47.632268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:47.641283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4f96ff52-beb2-430b-b77b-5c91e6013a92 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.164997 Aug 26 12:18:47.641857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 275/548] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:47 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:47.691438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:47.692133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:47.698547 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:47.699100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:47.699553 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:47.700234 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:47.700675 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:47.701088 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:47.831748 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:47.839939 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb081e3f-6f03-4c47-84f9-9af63e746da7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.152397 Aug 26 12:18:47.840511 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 274/549] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:47 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:48.161823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:48.162527 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:48.168775 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:48.169256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:48.169685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:48.170374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:48.170811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:48.171252 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:48.303855 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:48.312056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-147707cb-8bb3-41ac-b61b-2dda1d6c7278 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.154077 Aug 26 12:18:48.312618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 276/550] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:48 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:48.663362 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:48.664014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:48.670394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:48.670863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:48.671393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:48.672067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:48.672509 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:48.672922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:48.814496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:48.822785 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6bc86450-393c-403a-9c35-4856359c9a56 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.163363 Aug 26 12:18:48.823656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 275/551] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:48 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:48.861520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:48.862129 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:48.869171 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:48.869671 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:48.870835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:48.871830 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:48.872291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:48.872723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:49.007322 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:49.015683 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d9833319-0386-47e4-8bae-d061a91e466f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.158437 Aug 26 12:18:49.016249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 277/552] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:48 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:49.333308 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:49.333836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:49.339826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:49.340302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:49.340732 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:49.341451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:49.341881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:49.342301 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:49.469131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:49.476987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba4e9fde-4c81-4b93-8205-28e3e9c2bf09 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.147625 Aug 26 12:18:49.477545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 276/553] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:49 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:49.844960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:49.845576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:49.851511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:49.851999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:49.852452 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:49.853120 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:49.853573 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:49.853993 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:49.929233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7e7d8db8-51c2-41df-9481-5136373527ea req-c3aab3e6-c348-4dff-8825-bca5b20cdf66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c064ae-bbc4-419e-adb2-2ad34d8a75de", "name": "network-vif-plugged", "status": "completed", "tag": "e5b60208-99c9-44f8-8594-9d98d325d3dd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:49.935276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:49.947870 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e7d8db8-51c2-41df-9481-5136373527ea req-c3aab3e6-c348-4dff-8825-bca5b20cdf66 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:49.948312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e7d8db8-51c2-41df-9481-5136373527ea req-c3aab3e6-c348-4dff-8825-bca5b20cdf66 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:49.948791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e7d8db8-51c2-41df-9481-5136373527ea req-c3aab3e6-c348-4dff-8825-bca5b20cdf66 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:49.964257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7e7d8db8-51c2-41df-9481-5136373527ea req-c3aab3e6-c348-4dff-8825-bca5b20cdf66 service nova] Creating event network-vif-plugged:e5b60208-99c9-44f8-8594-9d98d325d3dd for instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de on hv-cinder-84630 Aug 26 12:18:49.969918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7e7d8db8-51c2-41df-9481-5136373527ea req-c3aab3e6-c348-4dff-8825-bca5b20cdf66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045432 Aug 26 12:18:49.970409 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 277/554] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:50.016847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:50.026602 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0acad33c-326f-4938-ab42-313b94b8ec4a tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.185135 Aug 26 12:18:50.027506 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 278/555] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:49 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:50.038386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:50.039078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:50.046458 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:50.047146 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:50.047613 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:50.048319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:50.048781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:50.049595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:50.193310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:50.203257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2e9bf7d-bea1-4607-822d-0db3ef7d9f40 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.169466 Aug 26 12:18:50.204063 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 278/556] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:50 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:50.498549 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:50.499161 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:50.501023 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:50.501696 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=14 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:18:50.507777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:50.508313 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:50.508767 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:50.509469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:50.509918 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:50.510347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:50.635779 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:50.643329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8276e237-8204-4b02-ae52-36892678963e tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.149250 Aug 26 12:18:50.643842 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 279/557] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:50 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:51.048728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:51.049250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:51.055754 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:51.056231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:51.056655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:51.057380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:51.057884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:51.058295 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:51.200875 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:51.209007 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41149ca7-816b-4280-8829-f60876eab36d tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.164227 Aug 26 12:18:51.209573 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 279/558] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:51 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:51.224662 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:51.225272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:51.231729 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:51.232210 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:51.232651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:51.233337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:51.233817 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:51.234236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:51.361548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:51.369546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00dad928-159d-42d9-9461-8d2513a83fff tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1368 microversion: 2.1 time: 0.148690 Aug 26 12:18:51.370726 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 280/559] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:51 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:51.664214 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:51.664804 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:51.671284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:51.671719 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:51.672139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:51.672824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:51.673270 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:51.673685 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:51.810348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:51.818299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c167b8fd-1d9a-4204-ba1e-51e6a1d4056b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.157973 Aug 26 12:18:51.818859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 280/560] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:51 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:51.986030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-67a8948f-208b-4145-ac7a-10c81cfbc447 req-76effccf-0239-459f-a966-6255ef64532e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9b53aa-f689-40c0-9034-c6c8473b8d8b", "name": "network-vif-plugged", "status": "completed", "tag": "8ad9d30d-e059-412b-8e9b-20bb4e3d46bd"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:51.996292 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-67a8948f-208b-4145-ac7a-10c81cfbc447 req-76effccf-0239-459f-a966-6255ef64532e service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:51.996762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-67a8948f-208b-4145-ac7a-10c81cfbc447 req-76effccf-0239-459f-a966-6255ef64532e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:51.997189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-67a8948f-208b-4145-ac7a-10c81cfbc447 req-76effccf-0239-459f-a966-6255ef64532e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.009096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-67a8948f-208b-4145-ac7a-10c81cfbc447 req-76effccf-0239-459f-a966-6255ef64532e service nova] Creating event network-vif-plugged:8ad9d30d-e059-412b-8e9b-20bb4e3d46bd for instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b on hv-cinder-84630 Aug 26 12:18:52.013990 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-67a8948f-208b-4145-ac7a-10c81cfbc447 req-76effccf-0239-459f-a966-6255ef64532e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Aug 26 12:18:52.014562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 281/561] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:52.229989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:52.231125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:52.237539 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.238029 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.238456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.239150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.239880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.240336 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.378532 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:52.387625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4e1d46a-938d-4e94-ba78-646470bcfac5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.161551 Aug 26 12:18:52.388190 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 281/562] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:52 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:52.391692 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:52.392431 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:52.398415 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.398901 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.399370 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.400072 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.400527 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.400983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.529593 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:52.537622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-57a6f9f5-00de-4593-a31c-db578b76adeb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1558 microversion: 2.1 time: 0.150906 Aug 26 12:18:52.538190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 282/563] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:52 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:18:52.557430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:52.557992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:52.563810 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.564278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.564701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.565370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.565812 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.566225 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.646628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37c09461-f9fc-48f2-9619-8365d1d6d3e1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093055 Aug 26 12:18:52.647260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 282/564] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:18:52 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:52.838972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:52.839713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:52.845622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.846111 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.846546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:52.847260 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:52.847714 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:52.848139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:53.092869 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:53.100865 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6e0f33cc-5dd8-4dcf-b09f-dc1e77db4be5 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1318 microversion: 2.1 time: 0.265977 Aug 26 12:18:53.101527 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 283/565] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:52 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:53.409418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:53.410023 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:53.415848 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:53.416326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:53.417245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:53.417927 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:53.418376 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:53.418801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:53.621054 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:53.629352 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c631e6df-522a-442e-a55b-3313bb8bfda5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.224363 Aug 26 12:18:53.629930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 283/566] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:53 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:53.704318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d570db50-52b3-42cf-8c93-1dd140ae1033 req-de7bc922-6c98-446a-8bd1-a454a0e89295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44c064ae-bbc4-419e-adb2-2ad34d8a75de", "tag": "e5b60208-99c9-44f8-8594-9d98d325d3dd"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:53.714338 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d570db50-52b3-42cf-8c93-1dd140ae1033 req-de7bc922-6c98-446a-8bd1-a454a0e89295 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:53.714961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d570db50-52b3-42cf-8c93-1dd140ae1033 req-de7bc922-6c98-446a-8bd1-a454a0e89295 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:53.715423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d570db50-52b3-42cf-8c93-1dd140ae1033 req-de7bc922-6c98-446a-8bd1-a454a0e89295 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:53.726377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d570db50-52b3-42cf-8c93-1dd140ae1033 req-de7bc922-6c98-446a-8bd1-a454a0e89295 service nova] Creating event network-changed:e5b60208-99c9-44f8-8594-9d98d325d3dd for instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de on hv-cinder-84630 Aug 26 12:18:53.731743 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-d570db50-52b3-42cf-8c93-1dd140ae1033 req-de7bc922-6c98-446a-8bd1-a454a0e89295 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031000 Aug 26 12:18:53.735187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 284/567] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:54.123325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:54.124315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:54.132094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:54.132673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:54.133169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:54.133923 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:54.134583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:54.134999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:54.274495 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:54.282527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-82bb144b-357e-4e06-93a5-244a4c97da24 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1506 microversion: 2.1 time: 0.163217 Aug 26 12:18:54.283349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 284/568] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:54 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:54.303525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f31c96af-0379-4add-b74e-a4c18306a260", "device": "/dev/sdb"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:18:54.305937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:54.312549 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:54.313267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:54.313698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:54.314387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:54.314834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:54.315281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:54.586282 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-376b54ef-3913-40ca-98d4-b1a53aa83962 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "POST /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286949 Aug 26 12:18:54.586906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 285/569] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:18:54 2022] POST /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:18:54.664205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:54.664824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:54.674306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:54.674798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:54.675262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:54.676030 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:54.676423 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:54.676843 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:54.844608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:54.853071 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2fd9cf4e-9fdc-4808-98fd-d67ab2861fa5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.195686 Aug 26 12:18:54.853634 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 285/570] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:54 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:55.875303 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:55.876011 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:55.882166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:55.882647 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:55.883085 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:55.883800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:55.884256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:55.884678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:56.031391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:56.039759 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ba5fc0b5-4313-480f-9b65-700edde2abe5 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1756 microversion: 2.1 time: 0.169509 Aug 26 12:18:56.040326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 286/571] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:55 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:18:57.062383 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:18:57.062986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:18:57.069630 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:57.070401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:57.070833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:57.071534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:18:57.071980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:18:57.072398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:18:57.211344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:18:57.219526 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aa69b453-f39a-4c0f-847b-310d628a220c tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1759 microversion: 2.1 time: 0.161287 Aug 26 12:18:57.220083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 286/572] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:18:57 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:08.719875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:08.720368 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:08.723026 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=59 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:08.723704 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:08.732351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:08.732844 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:08.733281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:08.733978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:08.734436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:08.734864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:08.971581 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lazy-loading 'services' on Instance uuid 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:09.043035 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-661508a4-7b6e-41fa-a9e5-ed1ff3622076 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "DELETE /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments/15ecf9c9-31f0-4031-ae13-fd5daa57d65f" status: 202 len: 0 microversion: 2.1 time: 0.326559 Aug 26 12:19:09.043779 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 287/573] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:19:08 2022] DELETE /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments/15ecf9c9-31f0-4031-ae13-fd5daa57d65f => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:19:09.052196 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:09.054578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:09.058570 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:09.059945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=80 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:09.065485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:09.065980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:09.066414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:09.067121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:09.067636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:09.068062 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:09.100103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e55cbf8-7394-4ddc-9f40-bfbdbb13c189 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051846 Aug 26 12:19:09.100601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 287/574] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:19:09 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:09.924538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:09.926853 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:09.934042 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:09.934545 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:09.934975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:09.935687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:09.936140 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:09.936559 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:09.965513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6933348b-5824-4b80-b420-3e4b2098cbe7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045199 Aug 26 12:19:09.966064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 288/575] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:19:09 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:19:10.028329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:10.028818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:10.034573 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:10.035054 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:10.035528 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:10.036208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:10.036655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:10.037075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:10.062386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:19:10.113586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:10.116451 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:10.123499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:10.124336 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:10.124773 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:10.125466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:10.125913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:10.126347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:10.136649 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8d914d0-5567-4e54-959c-cff2108b0430 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 204 len: 0 microversion: 2.1 time: 0.112203 Aug 26 12:19:10.137451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 288/576] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:19:10 2022] DELETE /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:19:10.145911 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:10.146702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:10.156418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:10.156944 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:10.157580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:10.158419 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:10.160135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:10.160947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:10.170791 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3d9f14b9-4884-4403-b4d0-a9637d6142b3 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062064 Aug 26 12:19:10.171682 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 289/577] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:19:10 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:19:10.341728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:10.349220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c62edc17-0054-44c4-b7bc-2b147e050025 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1672 microversion: 2.1 time: 0.207519 Aug 26 12:19:10.349780 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 289/578] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:10 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:19:11.183281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:11.185391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:11.191780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:11.192263 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:11.192697 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:11.193384 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:11.193835 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:11.194254 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:11.224006 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b9e5b827-9810-4b76-9a0e-b4749aabb024 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Aug 26 12:19:11.224558 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 290/579] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:19:11 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:11.369842 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:11.370450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:11.377027 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:11.377497 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:11.377935 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:11.378589 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:11.379032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:11.379471 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:11.514469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:11.522043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d26a6578-9b17-49f1-92b5-6392ae0e76f9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1672 microversion: 2.1 time: 0.156039 Aug 26 12:19:11.522604 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 290/580] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:11 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:12.235773 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:12.237969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:12.244799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:12.245270 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:12.245689 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:12.246442 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:12.246848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:12.247288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:12.275503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f56b19ed-0131-4e6e-9be2-fb7273452fcf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Aug 26 12:19:12.276053 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 291/581] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:19:12 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:12.544394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:12.545030 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:12.552029 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:12.552508 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:12.552942 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:12.553626 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:12.554104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:12.554524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:12.683055 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:12.690736 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1677c7b5-a540-4ef3-99ae-8a7b694713cf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1672 microversion: 2.1 time: 0.151304 Aug 26 12:19:12.691326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 291/582] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:12 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:13.288716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:13.290936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:13.299116 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.299649 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.300273 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.301202 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.302314 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.302753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.335596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cfdfa194-6b90-4e3d-ada5-6e881ea88d05 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050930 Aug 26 12:19:13.336321 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 292/583] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:19:13 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:19:13.416949 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:13.417431 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:13.424214 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.424693 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.425117 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.425811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.426261 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.426678 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.453884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:19:13.536486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b0c708dc-0ed1-472e-9566-63033d75d4d0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "DELETE /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 204 len: 0 microversion: 2.1 time: 0.123075 Aug 26 12:19:13.537100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 292/584] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:19:13 2022] DELETE /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:19:13.545564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:13.546174 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:13.552180 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.552665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.553106 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.553790 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.554242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.554663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.692214 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:13.700702 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cce9f44f-0be0-496a-99be-146659683267 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1689 microversion: 2.1 time: 0.159525 Aug 26 12:19:13.701275 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 293/585] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:13 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:13.712607 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:13.713411 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:13.720501 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.720971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.721397 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.722080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.722524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.722938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.857312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:13.865210 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a55bd83e-4d9a-49d4-9975-709cbb99a4c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1672 microversion: 2.1 time: 0.156718 Aug 26 12:19:13.865763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 293/586] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:13 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:13.944800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:13.945289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:13.952848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.953328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.953769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:13.954449 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:13.954897 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:13.955366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:14.045089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lazy-loading 'services' on Instance uuid bc9b53aa-f689-40c0-9034-c6c8473b8d8b {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:14.117516 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bb6db9b3-8f41-4fbf-ba7d-50fcd1aeb1f6 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b/os-volume_attachments/f31c96af-0379-4add-b74e-a4c18306a260" status: 202 len: 0 microversion: 2.1 time: 0.176481 Aug 26 12:19:14.118297 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 294/587] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:19:13 2022] DELETE /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b/os-volume_attachments/f31c96af-0379-4add-b74e-a4c18306a260 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 12:19:14.203267 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-55cecf57-9e4c-40fa-b74d-c1e97af28170 req-7f43bfa3-f78c-4f7d-bfb3-5924b4bc645b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6221ce4-7d73-44fa-a573-5d3b3146b9d8", "name": "network-vif-deleted", "tag": "4fd98237-b17a-4d7b-b281-7514f838bcf8"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:14.213657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-55cecf57-9e4c-40fa-b74d-c1e97af28170 req-7f43bfa3-f78c-4f7d-bfb3-5924b4bc645b service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:14.214137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-55cecf57-9e4c-40fa-b74d-c1e97af28170 req-7f43bfa3-f78c-4f7d-bfb3-5924b4bc645b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:14.214763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-55cecf57-9e4c-40fa-b74d-c1e97af28170 req-7f43bfa3-f78c-4f7d-bfb3-5924b4bc645b service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:14.226894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-55cecf57-9e4c-40fa-b74d-c1e97af28170 req-7f43bfa3-f78c-4f7d-bfb3-5924b4bc645b service nova] Creating event network-vif-deleted:4fd98237-b17a-4d7b-b281-7514f838bcf8 for instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 on hv-cinder-84630 Aug 26 12:19:14.232750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-55cecf57-9e4c-40fa-b74d-c1e97af28170 req-7f43bfa3-f78c-4f7d-bfb3-5924b4bc645b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033299 Aug 26 12:19:14.233357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 294/588] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:14.722315 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:14.722913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:14.729799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:14.730287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:14.730801 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:14.731533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:14.731982 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:14.732402 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:14.870304 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:14.878402 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5cbe1ea8-96e5-412f-bc0d-a079b41d0a00 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1689 microversion: 2.1 time: 0.160439 Aug 26 12:19:14.878977 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 295/589] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:14 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:14.891340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:14.891340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:14.894239 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:14.894794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:14.895326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:14.896223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:14.896743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:14.897236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:14.962470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:14.971075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9cbfaeb-599c-4959-8a75-bbca74bc0fd1 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1606 microversion: 2.1 time: 0.088921 Aug 26 12:19:14.971720 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 295/590] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:14 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:15.953643 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:15.954249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:15.960034 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:15.960511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:15.960940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:15.961620 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:15.962066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:15.962489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:15.992810 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:15.993528 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:16.000903 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:16.001315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:16.001748 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:16.002495 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:16.002940 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:16.003516 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:16.079119 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:16.086782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-10bb569d-1e46-4eff-aab1-c5f7a7a0d2ff tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1606 microversion: 2.1 time: 0.097960 Aug 26 12:19:16.087562 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 296/591] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:15 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1606 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:19:16.108166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:16.116177 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-11b122f1-4457-48d3-a2e8-92c88db430d1 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1689 microversion: 2.1 time: 0.219643 Aug 26 12:19:16.116824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 296/592] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:15 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:17.137797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:17.138437 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:17.144824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:17.145304 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:17.145732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:17.146419 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:17.146862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:17.147309 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:17.214213 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:17.215171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:17.225356 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:17.226856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:17.230365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:17.232317 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:17.232855 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:17.233286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:17.334711 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:17.338254 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:17.344716 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c530f4c9-d85f-4096-891f-47b81909c0de tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1322 microversion: 2.1 time: 0.240180 Aug 26 12:19:17.345882 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 297/593] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:17 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:17.348801 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7dd0564e-e105-4db8-a824-a348db36e2cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1689 microversion: 2.1 time: 0.215325 Aug 26 12:19:17.349560 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 297/594] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:17 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1689 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:19:18.366878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:18.367519 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:18.370360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:18.370976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:18.374815 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.375333 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.375754 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.376446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.376897 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.377309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.378513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.379006 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.379515 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.380219 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.380673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.381095 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.417348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.417834 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.418261 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.418710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lazy-loading 'fault' on Instance uuid c6221ce4-7d73-44fa-a573-5d3b3146b9d8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:18.500846 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:18.511364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f4cbc36-622c-4920-a24f-39da386afdf7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 200 len: 1327 microversion: 2.1 time: 0.149139 Aug 26 12:19:18.520153 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 298/595] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:18 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 1327 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:18.533146 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:18.534251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:18.540602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.541318 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.542549 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.544102 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.545672 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.546342 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.584473 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:19:18.631481 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:18.704369 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-878753d1-79b6-42ba-99b4-1c3ced1ea24b tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 204 len: 0 microversion: 2.1 time: 0.182501 Aug 26 12:19:18.705514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 299/596] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:19:18 2022] DELETE /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:19:18.714441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:18.715164 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:18.721486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.721975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.722425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.723185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:18.723707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:18.724308 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:18.844765 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:18.854044 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae5f8805-2746-4de5-81a0-637a4a3af725 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1689 microversion: 2.1 time: 0.487602 Aug 26 12:19:18.855393 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 298/597] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:18 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1689 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:19:18.891957 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:18.899730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-281f0365-9dd2-4c9d-a6dd-28aa69ff87f9 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1512 microversion: 2.1 time: 0.189870 Aug 26 12:19:18.900651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 300/598] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:18 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:19:19.043091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-1b29b95d-f5ab-4b01-8088-bb72abcc234c req-9dce0e2d-3dea-4839-9977-2926b1953fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75c5a14c-01ca-4ad0-94f0-cc7edcd90c48", "name": "network-vif-deleted", "tag": "2265e6e6-c3fa-4e50-bd81-1d0302423d65"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:19.053078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1b29b95d-f5ab-4b01-8088-bb72abcc234c req-9dce0e2d-3dea-4839-9977-2926b1953fc1 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:19.053551 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1b29b95d-f5ab-4b01-8088-bb72abcc234c req-9dce0e2d-3dea-4839-9977-2926b1953fc1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:19.053976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-1b29b95d-f5ab-4b01-8088-bb72abcc234c req-9dce0e2d-3dea-4839-9977-2926b1953fc1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:19.064910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-1b29b95d-f5ab-4b01-8088-bb72abcc234c req-9dce0e2d-3dea-4839-9977-2926b1953fc1 service nova] Creating event network-vif-deleted:2265e6e6-c3fa-4e50-bd81-1d0302423d65 for instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 on hv-cinder-84630 Aug 26 12:19:19.069797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-1b29b95d-f5ab-4b01-8088-bb72abcc234c req-9dce0e2d-3dea-4839-9977-2926b1953fc1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030318 Aug 26 12:19:19.070376 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 299/599] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:19.535327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:19.535933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:19.541764 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:19.542244 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:19.542674 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:19.543385 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:19.543835 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:19.544254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:19.557487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] HTTP exception thrown: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Request method failure captured: Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 HTTP/1.1 Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkZFLELr4TWwCaIR1iMNUm2smvd_LO2wPqlgXVHsQ-Cc467PNUcVJ1Yv4F7HwDbORpVK78mIvYmMNswkoXjeXMhywJvPuPTCK4NhJuifE2YrfuGII1tadiG_6-TlZ5uUIbM3eXkrm3VuDR3fcExRaQLvgFirD5hhzcvCnBNkzXLQVM Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:19:19.559113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_99e42555cbcd4716a1be1075f4a2b3b1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 2d9f1a5e4e77467f8a691b634a841de2 Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:19:19.561179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'c6221ce4-7d73-44fa-a573-5d3b3146b9d8'} Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:19:19.562060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:19:19.563617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:19.564959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Returning 404 to user: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:19:19.564959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e973ab1e-1394-4808-aca6-4fe97cc72ff3 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 404 len: 111 microversion: 2.1 time: 0.030233 Aug 26 12:19:19.564959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 301/600] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:19 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:19:19.570684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3ce68bad-4e28-41b3-a77e-5e40dc35a79f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '.version_select at 0x7ffa97953700>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:19.589818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3ce68bad-4e28-41b3-a77e-5e40dc35a79f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142325436" status: 202 len: 0 microversion: 2.1 time: 0.023596 Aug 26 12:19:19.590426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 300/601] 10.222.0.61 () {58 vars in 1221 bytes} [Fri Aug 26 12:19:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142325436 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:19:19.877598 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:19.878545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:19.885720 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:19.886200 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:19.886854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:19.887746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:19.889801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:19.890235 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:19.931866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:19.932869 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:19.940354 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:19.941083 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:19.941513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:19.942206 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:19.942831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:19.943068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:19.972432 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:19.982970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e1b1a6e-7449-4077-91df-0098354b32f0 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1622 microversion: 2.1 time: 0.110486 Aug 26 12:19:19.989819 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 302/602] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:19 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:20.156724 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:20.166887 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-70d37359-75f8-4954-8a81-970113fffdca tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1512 microversion: 2.1 time: 0.248870 Aug 26 12:19:20.167745 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 301/603] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:19 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1512 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:20.421692 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cad1b234-2c2a-471c-91c8-6b6a8ab0cb70 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'create', calling method: .version_select at 0x7ffa975d1e50>, body: {"keypair": {"name": "tempest-keypair-2037415154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6D1DoAiGazotLb1HUJgSiUtE6zk8WU+vtthNUhBTOwetB0mGFx8ZdQ5tDdOkTdz6rTYCBR9cJtJreNekqRqZGHXjJDiHMeaoIaE+um46TavuWGMBUJaZXQreQROfxfWw=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:20.443155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-cad1b234-2c2a-471c-91c8-6b6a8ab0cb70 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:19:20.447123 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-cad1b234-2c2a-471c-91c8-6b6a8ab0cb70 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for user 2d9f1a5e4e77467f8a691b634a841de2 and project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:19:20.476514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cad1b234-2c2a-471c-91c8-6b6a8ab0cb70 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059200 Aug 26 12:19:20.477199 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 303/604] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:19:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:21.004244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:21.004856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:21.012787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:21.015664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:21.016360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:21.017337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:21.017999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:21.018434 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:21.054840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:21.055991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:21.056595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:21.057406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lazy-loading 'fault' on Instance uuid 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:21.089997 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-705749e2-8a9a-41d8-83e6-7366cb77e493 req-afbe26b5-c5b9-407f-be83-b6d4e0135cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc9b53aa-f689-40c0-9034-c6c8473b8d8b", "name": "network-vif-deleted", "tag": "8ad9d30d-e059-412b-8e9b-20bb4e3d46bd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:21.102177 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-705749e2-8a9a-41d8-83e6-7366cb77e493 req-afbe26b5-c5b9-407f-be83-b6d4e0135cb3 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:21.102757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-705749e2-8a9a-41d8-83e6-7366cb77e493 req-afbe26b5-c5b9-407f-be83-b6d4e0135cb3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:21.103339 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-705749e2-8a9a-41d8-83e6-7366cb77e493 req-afbe26b5-c5b9-407f-be83-b6d4e0135cb3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:21.117023 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-705749e2-8a9a-41d8-83e6-7366cb77e493 req-afbe26b5-c5b9-407f-be83-b6d4e0135cb3 service nova] Creating event network-vif-deleted:8ad9d30d-e059-412b-8e9b-20bb4e3d46bd for instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b on hv-cinder-84630 Aug 26 12:19:21.122488 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-705749e2-8a9a-41d8-83e6-7366cb77e493 req-afbe26b5-c5b9-407f-be83-b6d4e0135cb3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036759 Aug 26 12:19:21.123696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 304/605] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:21.137462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:21.150547 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eb9e1c19-5c3b-4cb4-8dd6-9663598dfd28 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 200 len: 1335 microversion: 2.1 time: 0.149882 Aug 26 12:19:21.151565 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 302/606] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:20 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 1335 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:21.192215 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:21.193298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:21.201594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:21.202814 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:21.203691 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:21.204922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:21.205579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:21.206190 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:21.247978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:21.248971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:21.249765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:21.249924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lazy-loading 'fault' on Instance uuid bc9b53aa-f689-40c0-9034-c6c8473b8d8b {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:21.307269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7d0a1ee39274a0d90a2be9fbc26a58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ab22ea009914891b1f594ed3d1e4ec3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:21.316647 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22450215-a3b5-45eb-92cf-652542a5157f tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 200 len: 1308 microversion: 2.1 time: 0.131469 Aug 26 12:19:21.317254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 305/607] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:21 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:21.840040 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-238626452", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbbcd3d6-4849-4648-a1f4-b172dd116d92"}], "security_groups": [{"name": "tempest-securitygroup--978019523"}], "key_name": "tempest-keypair-2037415154", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:21.949793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] validate_networks() for [('bbbcd3d6-4849-4648-a1f4-b172dd116d92', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:19:22.172139 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:22.172760 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:22.179247 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:22.179722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:22.180147 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:22.180830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:22.181272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:22.181687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:22.195454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] HTTP exception thrown: Instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 could not be found. Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Request method failure captured: Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 HTTP/1.1 Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkWNTQVOh-73fS3fVnMdoZwjJF4hSzPJugXKBzjT0CDmZY_79b-Stos2SO622p9EhnU1TyD3iAl7uru5C1Pm0w3rY4VqtDvxPc9Q-90zV55zke8UuNi33P0RSwSAcMEYglTjKX-6zNL-HS6Madg6ekec-OK3k7beuOCXJOBPHp7Nts Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:19:22.197078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/984b6ea268f04e8989283e6397b68370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_984b6ea268f04e8989283e6397b68370", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: a02508c20bd547708638c1875101da6f Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 could not be found. Aug 26 12:19:22.198390 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '75c5a14c-01ca-4ad0-94f0-cc7edcd90c48'} Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 could not be found. Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:19:22.199131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 could not be found. Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 could not be found. Aug 26 12:19:22.200349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.202104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Returning 404 to user: Instance 75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:19:22.202104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df2ead67-6179-4264-bd90-ef1372aa68d6 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48" status: 404 len: 111 microversion: 2.1 time: 0.030444 Aug 26 12:19:22.202104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 306/608] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:22 2022] GET /compute/v2.1/servers/75c5a14c-01ca-4ad0-94f0-cc7edcd90c48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 12:19:22.207611 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d5f0f5f-5be3-47f2-966f-be1fa0f36301 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '.version_select at 0x7ffa975d6e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:22.226382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d5f0f5f-5be3-47f2-966f-be1fa0f36301 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544728634" status: 202 len: 0 microversion: 2.1 time: 0.022164 Aug 26 12:19:22.226987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 307/609] 10.222.0.61 () {58 vars in 1221 bytes} [Fri Aug 26 12:19:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544728634 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:19:22.337985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:22.338746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] [instance: bc9b53aa-f689-40c0-9034-c6c8473b8d8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:22.344929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:22.345496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:22.346018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:22.346807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:22.347363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:22.347865 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:22.360372 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:19:22.361499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:19:22.362096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:19:22.362535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:19:22.363124 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:19:22.364759 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] HTTP exception thrown: Instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b could not be found. Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Request method failure captured: Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b HTTP/1.1 Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLm_4xeHQGBTzMYSQ-5I_D3whEeESFM5VEiKn327e0k_v7v7WPU1vT1ma6nHrmI0sr9dPne99vccyj18_NelX7VyQrEmsdmrqRTIHEQgked8SZaJ8N4F9DMLC3fXceNnthfAdIphZ7seDS7x4NWHCLjUZHtzRzG0FekmvvJ_VR-Mn8c Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 2ab22ea009914891b1f594ed3d1e4ec3 Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1170467750 Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:19:22.366710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2ab22ea009914891b1f594ed3d1e4ec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2ab22ea009914891b1f594ed3d1e4ec3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2ab22ea009914891b1f594ed3d1e4ec3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2ab22ea009914891b1f594ed3d1e4ec3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesSnapshotTestJSON-1170467750 Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 2ab22ea009914891b1f594ed3d1e4ec3 Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1170467750 Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesSnapshotTestJSON-1170467750-project Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: a7d0a1ee39274a0d90a2be9fbc26a58b Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesSnapshotTestJSON-1170467750-project Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b could not be found. Aug 26 12:19:22.368565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'bc9b53aa-f689-40c0-9034-c6c8473b8d8b'} Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b could not be found. Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:19:22.369445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b could not be found. Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b could not be found. Aug 26 12:19:22.370798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:22.373544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:22.374153 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:22.374650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:22.375407 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:22.375812 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:22.376235 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:22.376891 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] Returning 404 to user: Instance bc9b53aa-f689-40c0-9034-c6c8473b8d8b could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:19:22.377869 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3a1e022-ac29-4a01-ac94-89ccb1868957 tempest-VolumesSnapshotTestJSON-1170467750 tempest-VolumesSnapshotTestJSON-1170467750-project] 10.222.0.61 "GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b" status: 404 len: 111 microversion: 2.1 time: 0.044062 Aug 26 12:19:22.378518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 308/610] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:22 2022] GET /compute/v2.1/servers/bc9b53aa-f689-40c0-9034-c6c8473b8d8b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:19:22.396849 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:19:22.401742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Getting quotas for user 2d9f1a5e4e77467f8a691b634a841de2 and project 99e42555cbcd4716a1be1075f4a2b3b1. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:19:22.421573 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:19:22.424590 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:19:22.486141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b23e416f-0c98-4f5b-adc5-96ebb08246ef tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.650092 Aug 26 12:19:22.486931 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 303/611] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:19:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:19:22.497840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b5335bd2-5b6e-4450-922b-eb064f48a700 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:22.498840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b5335bd2-5b6e-4450-922b-eb064f48a700 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:22.582781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b5335bd2-5b6e-4450-922b-eb064f48a700 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:22.591079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b5335bd2-5b6e-4450-922b-eb064f48a700 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1237 microversion: 2.1 time: 0.097026 Aug 26 12:19:22.593690 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 309/612] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:22 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:23.615524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:23.616139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:23.623493 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:23.624097 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:23.624566 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:23.625258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:23.625713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:23.626136 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:23.630206 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:23.688387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:23.695876 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a2c1938d-8145-45a7-98db-57c145935e6a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1289 microversion: 2.1 time: 0.084990 Aug 26 12:19:23.696436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 304/613] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:23 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:24.717909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:24.718511 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:24.725792 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:24.726195 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:24.726624 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:24.727327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:24.727775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:24.728185 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:24.856476 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:24.864577 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c27f4b86-49ec-4157-9bad-6b9f24d4a87c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.150931 Aug 26 12:19:24.865136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 310/614] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:24 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:25.885601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:25.886208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:25.893214 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:25.893729 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:25.894184 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:25.894894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:25.895380 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:25.895802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:26.050601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:26.062777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2bc305a6-f82d-496c-bc10-406161e46958 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.180985 Aug 26 12:19:26.063707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 305/615] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:25 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:26.454727 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f0cffd0a-f9e2-4478-9a3e-a15e61070947 req-f7794e60-f0e9-437a-addb-1edf2a769342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938ea034-600f-4b82-a62a-38d5a319a78f", "tag": "fbd0f5f7-c070-4ecf-9981-fdeb97928cf5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:26.464433 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f0cffd0a-f9e2-4478-9a3e-a15e61070947 req-f7794e60-f0e9-437a-addb-1edf2a769342 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:26.465044 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f0cffd0a-f9e2-4478-9a3e-a15e61070947 req-f7794e60-f0e9-437a-addb-1edf2a769342 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:26.465495 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f0cffd0a-f9e2-4478-9a3e-a15e61070947 req-f7794e60-f0e9-437a-addb-1edf2a769342 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:26.477219 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f0cffd0a-f9e2-4478-9a3e-a15e61070947 req-f7794e60-f0e9-437a-addb-1edf2a769342 service nova] Creating event network-changed:fbd0f5f7-c070-4ecf-9981-fdeb97928cf5 for instance 938ea034-600f-4b82-a62a-38d5a319a78f on hv-cinder-84630 Aug 26 12:19:26.482644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f0cffd0a-f9e2-4478-9a3e-a15e61070947 req-f7794e60-f0e9-437a-addb-1edf2a769342 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030946 Aug 26 12:19:26.483243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 311/616] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:27.082978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:27.083738 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:27.091001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:27.092184 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:27.092719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:27.093530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:27.094045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:27.094564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:27.248411 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:27.257885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e4754a36-82c8-4feb-b7c1-96ca4efe46ea tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.178308 Aug 26 12:19:27.258530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 306/617] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:27 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:27.337525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:27.338228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:27.342368 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 12:19:27.342567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Fri Aug 26 12:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c (ip 10.222.0.61) !!! Aug 26 12:19:27.349561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:27.350223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:27.350646 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:27.351667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:27.352171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:27.352664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:27.382121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:19:27.486152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6abc0554-2ce6-4a4d-92ee-72fbcfc82551 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 204 len: 0 microversion: 2.1 time: 0.154048 Aug 26 12:19:27.491300 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 312/618] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:19:27 2022] DELETE /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:19:27.500752 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:27.501691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:27.508807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:27.509512 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:27.510128 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:27.510845 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:27.511331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:27.511760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:27.654927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:27.663010 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bbb5310a-a864-44b3-9732-ea90d93a85f8 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1506 microversion: 2.1 time: 0.167568 Aug 26 12:19:27.663633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 307/619] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:27 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:28.280073 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:28.280792 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:28.286697 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:28.287183 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:28.287667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:28.288378 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:28.288826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:28.289246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:28.415768 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:28.423962 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7d901af-c430-475f-8384-4737e5fb16ae tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.148188 Aug 26 12:19:28.424523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 313/620] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:28 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:28.684540 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:28.685485 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:28.696602 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:28.696602 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:28.696602 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:28.696602 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:28.696967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:28.696967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:28.823820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:28.832892 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68418f16-3919-454e-ac0d-024d3a67a280 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1506 microversion: 2.1 time: 0.152199 Aug 26 12:19:28.833467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 308/621] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:28 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:29.445617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:29.446222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:29.452629 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:29.453106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:29.453535 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:29.454216 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:29.454663 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:29.455079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:29.595550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:29.603188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b11a0c32-2f2a-4b42-a13d-dd0ec193302c tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.161708 Aug 26 12:19:29.603776 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 314/622] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:29 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:29.854395 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:29.855070 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:29.862669 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:29.863159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:29.863629 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:29.864578 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:29.865035 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:29.865572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:30.022030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:30.030769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-969dc4b7-de10-4ce8-92b4-9c77b6ac884f tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1506 microversion: 2.1 time: 0.181026 Aug 26 12:19:30.031455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 309/623] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:29 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:30.623400 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:30.624037 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:30.627492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:30.631635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:30.632117 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:30.632550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:30.633236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:30.633686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:30.634105 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:30.770138 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:30.777952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d648ebb4-345f-40dc-b27d-548f3216a9c8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.158530 Aug 26 12:19:30.778587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 315/624] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:30 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:31.052543 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:31.053258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:31.060524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:31.061538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:31.061788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:31.062490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:31.062942 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:31.063537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:31.229980 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:31.240262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e62b821b-68d8-41d1-8e29-f5fc74e504d2 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1506 microversion: 2.1 time: 0.191810 Aug 26 12:19:31.240842 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 310/625] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:31 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:31.498996 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f4f125ae-5cc2-4036-983b-879c301e4119 req-15f6bb43-d581-4d26-a397-397981950621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9578f0-4366-4a4f-859c-22dc57bbe34c", "name": "network-vif-deleted", "tag": "84cd0865-63ff-4284-8278-850c455a4464"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:31.508806 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f4f125ae-5cc2-4036-983b-879c301e4119 req-15f6bb43-d581-4d26-a397-397981950621 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:31.509276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f4f125ae-5cc2-4036-983b-879c301e4119 req-15f6bb43-d581-4d26-a397-397981950621 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:31.509700 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f4f125ae-5cc2-4036-983b-879c301e4119 req-15f6bb43-d581-4d26-a397-397981950621 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:31.520887 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f4f125ae-5cc2-4036-983b-879c301e4119 req-15f6bb43-d581-4d26-a397-397981950621 service nova] Creating event network-vif-deleted:84cd0865-63ff-4284-8278-850c455a4464 for instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c on hv-cinder-84630 Aug 26 12:19:31.525670 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f4f125ae-5cc2-4036-983b-879c301e4119 req-15f6bb43-d581-4d26-a397-397981950621 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030969 Aug 26 12:19:31.526251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 316/626] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:31.800328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:31.800949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:31.806961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:31.807493 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:31.807939 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:31.808653 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:31.809110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:31.809536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:31.944261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:31.951787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68fb82b3-ae21-4841-aa13-fee96228052a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.156319 Aug 26 12:19:31.952343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 311/627] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:31 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:32.262863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:32.263586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:32.270388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:32.270874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:32.271345 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:32.272078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:32.272484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:32.272906 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:32.335741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:32.344054 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50623241-b0a1-435f-a53e-618ac51f6862 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1464 microversion: 2.1 time: 0.085865 Aug 26 12:19:32.344609 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 317/628] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:32 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1464 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:32.972106 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:32.972837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:32.975128 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:32.975809 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:32.981355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:32.981839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:32.982274 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:32.983076 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:32.983554 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:32.984468 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:33.111357 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:33.119164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f6d7f50b-3639-400c-a0c1-e4bd1681079f tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.150873 Aug 26 12:19:33.119760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 312/629] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:32 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:33.364860 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:33.365498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:33.367614 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:33.373516 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:33.373997 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:33.374435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:33.375418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:33.375877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:33.376302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:33.438327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:33.446915 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42df5c4e-8f92-4428-bc6a-0b85162ba4cf tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1292 microversion: 2.1 time: 0.086256 Aug 26 12:19:33.447510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 318/630] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:33 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:34.140792 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:34.141562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:34.147979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:34.148465 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:34.148906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:34.149625 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:34.150081 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:34.150506 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:34.281025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:34.288664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c7fc19c-0e39-4fd0-9810-f09f89591cb2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.152579 Aug 26 12:19:34.289237 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 313/631] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:34 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:34.467183 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:34.467804 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:34.474538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:34.474927 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:34.475398 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:34.476082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:34.476523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:34.476936 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:34.509266 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:34.509740 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:34.510162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:34.510602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lazy-loading 'fault' on Instance uuid 6a9578f0-4366-4a4f-859c-22dc57bbe34c {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:34.552254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:34.560422 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05171c54-b435-43f6-afdc-b56b7bb504f9 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 200 len: 1311 microversion: 2.1 time: 0.097045 Aug 26 12:19:34.560973 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 319/632] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:34 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:35.058003 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-6a3953d3-0ee7-4e71-9984-27449afc2130 req-fdd995ba-8207-4881-a322-e09a4ca5d053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938ea034-600f-4b82-a62a-38d5a319a78f", "name": "network-vif-plugged", "status": "completed", "tag": "fbd0f5f7-c070-4ecf-9981-fdeb97928cf5"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:35.067530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6a3953d3-0ee7-4e71-9984-27449afc2130 req-fdd995ba-8207-4881-a322-e09a4ca5d053 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.068009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6a3953d3-0ee7-4e71-9984-27449afc2130 req-fdd995ba-8207-4881-a322-e09a4ca5d053 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.068430 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6a3953d3-0ee7-4e71-9984-27449afc2130 req-fdd995ba-8207-4881-a322-e09a4ca5d053 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.081376 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6a3953d3-0ee7-4e71-9984-27449afc2130 req-fdd995ba-8207-4881-a322-e09a4ca5d053 service nova] Creating event network-vif-plugged:fbd0f5f7-c070-4ecf-9981-fdeb97928cf5 for instance 938ea034-600f-4b82-a62a-38d5a319a78f on hv-cinder-84630 Aug 26 12:19:35.086197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-6a3953d3-0ee7-4e71-9984-27449afc2130 req-fdd995ba-8207-4881-a322-e09a4ca5d053 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031874 Aug 26 12:19:35.086940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 314/633] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:35.309997 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:35.310606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:35.316600 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.317082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.317518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.318244 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.318696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.319189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.323099 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:35.455439 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:35.463038 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e834061-5488-49fb-ab82-ff24f9263f8d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.157001 Aug 26 12:19:35.463643 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 320/634] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:35 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:35.583800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:35.584656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 6a9578f0-4366-4a4f-859c-22dc57bbe34c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:35.590656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.591139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.591604 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.592299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.592754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.593455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.608056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] HTTP exception thrown: Instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c could not be found. Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Request method failure captured: Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c HTTP/1.1 Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkWNTQVOh-73fS3fVnMdoZwjJF4hSzPJugXKBzjT0CDmZY_79b-Stos2SO622p9EhnU1TyD3iAl7uru5C1Pm0w3rY4VqtDvxPc9Q-90zV55zke8UuNi33P0RSwSAcMEYglTjKX-6zNL-HS6Madg6ekec-OK3k7beuOCXJOBPHp7Nts Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:19:35.609989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/984b6ea268f04e8989283e6397b68370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_984b6ea268f04e8989283e6397b68370", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: a02508c20bd547708638c1875101da6f Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c could not be found. Aug 26 12:19:35.611776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '6a9578f0-4366-4a4f-859c-22dc57bbe34c'} Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c could not be found. Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:19:35.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c could not be found. Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c could not be found. Aug 26 12:19:35.617927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:35.620329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Returning 404 to user: Instance 6a9578f0-4366-4a4f-859c-22dc57bbe34c could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:19:35.620329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bddf43a8-5844-44ff-aa9a-f68bd08948cc tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c" status: 404 len: 111 microversion: 2.1 time: 0.032342 Aug 26 12:19:35.620329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 315/635] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:35 2022] GET /compute/v2.1/servers/6a9578f0-4366-4a4f-859c-22dc57bbe34c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:19:35.626091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:35.626584 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:35.632876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.633361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.633818 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.634508 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.634961 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.635416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.670146 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:19:35.754173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c912e0fa-a0f8-480b-9e68-e7a34270e7aa tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "DELETE /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 204 len: 0 microversion: 2.1 time: 0.131982 Aug 26 12:19:35.754837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 321/636] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:19:35 2022] DELETE /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:19:35.763404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:35.764018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:35.770576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.771066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.771544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.772368 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:35.773030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:35.773625 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:35.903749 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:35.911336 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-18930eb8-c95b-4aea-83d5-06fd24930474 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.151753 Aug 26 12:19:35.911893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 316/637] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:35 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:36.485467 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:36.486162 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:36.492334 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:36.492807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:36.493236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:36.493918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:36.494395 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:36.494812 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:36.624583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:36.632144 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8086b43-cada-416f-b6e0-1d3766a06594 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.151639 Aug 26 12:19:36.632731 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 322/638] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:36 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:36.933158 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:36.933763 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:36.940700 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:36.941182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:36.941613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:36.942299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:36.942746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:36.943164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:37.072715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:37.081012 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ab57e573-d491-442b-9617-923066d97e85 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.151849 Aug 26 12:19:37.081568 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 317/639] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:36 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:37.652992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:37.653594 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:37.660771 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:37.661246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:37.661675 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:37.662354 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:37.662804 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:37.663238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:37.789701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:37.797972 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3073136f-c92f-4f30-8c6a-a66974973c49 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.148832 Aug 26 12:19:37.798540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 323/640] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:37 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:38.101480 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:38.102154 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:38.108511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:38.109067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:38.109581 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:38.110267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:38.110717 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:38.111135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:38.244059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:38.251896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-12ffdfc1-d298-4bdf-80c0-20ec5463c078 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.154413 Aug 26 12:19:38.252458 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 318/641] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:38 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:38.818550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:38.819149 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:38.825639 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:38.826112 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:38.826541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:38.827228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:38.827734 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:38.828182 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:38.956427 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:38.963991 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6729e27-87d5-4ff0-9908-75d0ff9871f8 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.149340 Aug 26 12:19:38.964553 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 324/642] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:38 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:39.272460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:39.273123 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:39.275676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:39.281392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:39.282059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:39.282488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:39.283175 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:39.283648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:39.284058 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:39.419458 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:39.427919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-485df337-36af-40f0-82b7-0aa29984f230 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1521 microversion: 2.1 time: 0.159362 Aug 26 12:19:39.428485 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 319/643] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:39 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:39.984814 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:39.985447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:39.992251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:39.992738 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:39.993168 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:39.993882 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:39.994329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:39.994747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:40.131045 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:40.138931 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8521969-c10f-4e26-8ac1-b71eb1dce2fa tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1362 microversion: 2.1 time: 0.158161 Aug 26 12:19:40.139794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 325/644] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:39 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:19:40.441108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-310d46a5-9c7b-4ccf-89a5-ff16130e9d2e req-1e8adc32-6b05-4bec-8609-d6968a0ebcbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dfffd0-58c9-4344-af80-b48af9048808", "name": "network-vif-deleted", "tag": "85be8f03-a604-494a-b7b1-6edbd51be386"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:40.448830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:40.449684 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:40.451915 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-310d46a5-9c7b-4ccf-89a5-ff16130e9d2e req-1e8adc32-6b05-4bec-8609-d6968a0ebcbb service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:40.452551 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-310d46a5-9c7b-4ccf-89a5-ff16130e9d2e req-1e8adc32-6b05-4bec-8609-d6968a0ebcbb service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:40.453354 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-310d46a5-9c7b-4ccf-89a5-ff16130e9d2e req-1e8adc32-6b05-4bec-8609-d6968a0ebcbb service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:40.455930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:40.456651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:40.457308 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:40.458208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:40.458861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:40.459429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:40.465068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-310d46a5-9c7b-4ccf-89a5-ff16130e9d2e req-1e8adc32-6b05-4bec-8609-d6968a0ebcbb service nova] Creating event network-vif-deleted:85be8f03-a604-494a-b7b1-6edbd51be386 for instance 48dfffd0-58c9-4344-af80-b48af9048808 on hv-cinder-84630 Aug 26 12:19:40.469970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-310d46a5-9c7b-4ccf-89a5-ff16130e9d2e req-1e8adc32-6b05-4bec-8609-d6968a0ebcbb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095401 Aug 26 12:19:40.470561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 320/645] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:40.494028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:40.494512 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:40.494945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:40.495423 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lazy-loading 'fault' on Instance uuid 48dfffd0-58c9-4344-af80-b48af9048808 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:40.539498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a02508c20bd547708638c1875101da6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984b6ea268f04e8989283e6397b68370', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:40.548166 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b64a8b8-6bda-47ec-a704-931c60036935 tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 200 len: 1312 microversion: 2.1 time: 0.103349 Aug 26 12:19:40.548720 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 326/646] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:40 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:19:41.161174 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:41.161930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:41.168812 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:41.169303 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:41.169761 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:41.170453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:41.170902 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:41.171976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:41.303530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:41.311166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-04235f08-67cc-4a8d-98ea-44d48409ea2d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1549 microversion: 2.1 time: 0.154382 Aug 26 12:19:41.312353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 321/647] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:41 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:19:41.331377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:41.331854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:41.338343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:41.339043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:41.339498 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:41.340177 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:41.340782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:41.341025 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:41.422667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f2fd784-bd02-4ad4-ba63-31f5b0f84c67 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095134 Aug 26 12:19:41.423278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 327/648] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:19:41 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:41.569479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:41.570118 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] [instance: 48dfffd0-58c9-4344-af80-b48af9048808] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:41.576242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:41.576742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:41.577183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:41.578816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:41.579383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:41.579820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:41.593534 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] HTTP exception thrown: Instance 48dfffd0-58c9-4344-af80-b48af9048808 could not be found. Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Request method failure captured: Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 HTTP/1.1 Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkWNTQVOh-73fS3fVnMdoZwjJF4hSzPJugXKBzjT0CDmZY_79b-Stos2SO622p9EhnU1TyD3iAl7uru5C1Pm0w3rY4VqtDvxPc9Q-90zV55zke8UuNi33P0RSwSAcMEYglTjKX-6zNL-HS6Madg6ekec-OK3k7beuOCXJOBPHp7Nts Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:19:41.595194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/984b6ea268f04e8989283e6397b68370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_984b6ea268f04e8989283e6397b68370", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/984b6ea268f04e8989283e6397b68370"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 984b6ea268f04e8989283e6397b68370 Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-958635153 Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: a02508c20bd547708638c1875101da6f Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-958635153-project Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 48dfffd0-58c9-4344-af80-b48af9048808 could not be found. Aug 26 12:19:41.596598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '48dfffd0-58c9-4344-af80-b48af9048808'} Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48dfffd0-58c9-4344-af80-b48af9048808 could not be found. Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:19:41.597373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48dfffd0-58c9-4344-af80-b48af9048808 could not be found. Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48dfffd0-58c9-4344-af80-b48af9048808 could not be found. Aug 26 12:19:41.598613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:19:41.599754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] Returning 404 to user: Instance 48dfffd0-58c9-4344-af80-b48af9048808 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:19:41.599754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4df323bb-1b99-4b77-8885-1ee9545627db tempest-ServerRescueNegativeTestJSON-958635153 tempest-ServerRescueNegativeTestJSON-958635153-project] 10.222.0.61 "GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808" status: 404 len: 111 microversion: 2.1 time: 0.031560 Aug 26 12:19:41.599754 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 322/649] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:19:41 2022] GET /compute/v2.1/servers/48dfffd0-58c9-4344-af80-b48af9048808 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 12:19:42.666530 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-38e2e3a0-bf3d-4c54-a9c4-d07a6354469e req-b097b77a-636e-4c71-a26a-27274d372317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938ea034-600f-4b82-a62a-38d5a319a78f", "tag": "fbd0f5f7-c070-4ecf-9981-fdeb97928cf5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:42.683251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38e2e3a0-bf3d-4c54-a9c4-d07a6354469e req-b097b77a-636e-4c71-a26a-27274d372317 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:42.684016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38e2e3a0-bf3d-4c54-a9c4-d07a6354469e req-b097b77a-636e-4c71-a26a-27274d372317 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:42.684651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38e2e3a0-bf3d-4c54-a9c4-d07a6354469e req-b097b77a-636e-4c71-a26a-27274d372317 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:42.697804 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-38e2e3a0-bf3d-4c54-a9c4-d07a6354469e req-b097b77a-636e-4c71-a26a-27274d372317 service nova] Creating event network-changed:fbd0f5f7-c070-4ecf-9981-fdeb97928cf5 for instance 938ea034-600f-4b82-a62a-38d5a319a78f on hv-cinder-84630 Aug 26 12:19:42.711670 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-38e2e3a0-bf3d-4c54-a9c4-d07a6354469e req-b097b77a-636e-4c71-a26a-27274d372317 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136333 Aug 26 12:19:42.712942 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 328/650] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:48.925175 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:48.925741 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:48.931823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:48.932388 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:48.932930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:48.933769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:48.934294 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:48.934788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:48.955937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:48.964618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7cb15486-17c7-4f45-aa3e-848834982285 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/ips" status: 200 len: 149 microversion: 2.1 time: 0.276050 Aug 26 12:19:48.968028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 323/651] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:19:48 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/ips => generated 149 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:50.396394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5e8422-7ad5-4229-813a-e37f09f2ad58"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:50.400110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:50.409488 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:50.410138 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:50.410583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:50.411342 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:50.411798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:50.412223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:50.712010 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d49fbfb-7922-4812-8c96-26a155dedbb4 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313941 Aug 26 12:19:50.712861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 329/652] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:19:50 2022] POST /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:50.786948 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c8e99361-8692-4255-93c4-1244f6ac2813 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'create', calling method: .version_select at 0x7ffa97953af0>, body: {"keypair": {"name": "tempest-keypair-408346414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTHfFa1lPRqbjaz+ZKA9MtZ3FAykFRLcZkcahfMeyYZRhmioI+lzm6sfPqYdwkY2hp+f4fMeMPA1HCYIFMc5CL+JlIiDDyERO2tzProok1XVZN6EXQ3ToHgUkYJsLweLA=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:50.806882 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-c8e99361-8692-4255-93c4-1244f6ac2813 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for project f4583d65a595463b97e8dfabbf3da521. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:19:50.813943 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-c8e99361-8692-4255-93c4-1244f6ac2813 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for user 0e013faf32b84179989eb99be958555f and project f4583d65a595463b97e8dfabbf3da521. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:19:50.837243 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c8e99361-8692-4255-93c4-1244f6ac2813 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.134604 Aug 26 12:19:50.837952 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 324/653] 10.222.0.61 () {62 vars in 1200 bytes} [Fri Aug 26 12:19:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 26 12:19:52.401052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1178219602", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a9c1701-9f05-4cb0-be4d-041018795491"}], "security_groups": [{"name": "tempest-securitygroup--1491833590"}], "key_name": "tempest-keypair-408346414", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:52.507775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] validate_networks() for [('5a9c1701-9f05-4cb0-be4d-041018795491', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:19:52.933077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:19:52.933579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:19:52.934051 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:19:52.934460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:19:52.934867 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:19:52.943978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:52.944446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:52.944885 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:52.945646 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:52.946096 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:52.946517 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:52.963975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for project f4583d65a595463b97e8dfabbf3da521. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:19:52.968382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for user 0e013faf32b84179989eb99be958555f and project f4583d65a595463b97e8dfabbf3da521. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:19:52.979940 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:19:52.982343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:19:53.033282 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-299bae60-888b-432e-b596-a91cf9924879 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.637582 Aug 26 12:19:53.034575 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 330/654] 10.222.0.61 () {62 vars in 1188 bytes} [Fri Aug 26 12:19:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 12:19:53.047141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-187c9bac-de6b-4443-9368-4afc4aa780bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:53.047922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-187c9bac-de6b-4443-9368-4afc4aa780bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:53.110200 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-187c9bac-de6b-4443-9368-4afc4aa780bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:53.119348 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-187c9bac-de6b-4443-9368-4afc4aa780bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:53.120805 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-187c9bac-de6b-4443-9368-4afc4aa780bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:53.121988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-187c9bac-de6b-4443-9368-4afc4aa780bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1281 microversion: 2.20 time: 0.080007 Aug 26 12:19:53.122561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 325/655] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:19:53 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:19:54.145014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:54.146228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:54.154215 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:54.154925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:54.156116 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:54.157140 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:54.157586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:54.158268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:54.234074 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:54.245552 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:54.247530 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:54.248702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b4efc5dc-afff-4182-930c-76d8449b34d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1333 microversion: 2.20 time: 0.107676 Aug 26 12:19:54.259883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 331/656] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:19:54 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:19:55.274398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:55.274929 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:55.282193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:55.282685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:55.283123 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:55.283919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:55.284367 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:55.284790 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:55.414252 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:55.423483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:55.424938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:55.426079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9ac76314-cd85-426d-9d83-161e10c8c695 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.155643 Aug 26 12:19:55.426641 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 326/657] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:19:55 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:19:55.658948 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d5648a4c-090b-41ba-a1b4-48013d03d689 req-e2323e57-8868-4e7e-986e-f9327aa4001a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79b22dd-76aa-4cd2-814b-5d61b81a73bd", "tag": "6d70c9aa-09a0-4252-9c28-50bff97caa6f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:55.670705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5648a4c-090b-41ba-a1b4-48013d03d689 req-e2323e57-8868-4e7e-986e-f9327aa4001a service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:55.671310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5648a4c-090b-41ba-a1b4-48013d03d689 req-e2323e57-8868-4e7e-986e-f9327aa4001a service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:55.671743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5648a4c-090b-41ba-a1b4-48013d03d689 req-e2323e57-8868-4e7e-986e-f9327aa4001a service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:55.683128 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d5648a4c-090b-41ba-a1b4-48013d03d689 req-e2323e57-8868-4e7e-986e-f9327aa4001a service nova] Creating event network-changed:6d70c9aa-09a0-4252-9c28-50bff97caa6f for instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd on hv-cinder-84630 Aug 26 12:19:55.688557 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d5648a4c-090b-41ba-a1b4-48013d03d689 req-e2323e57-8868-4e7e-986e-f9327aa4001a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033321 Aug 26 12:19:55.689373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 332/658] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:56.451485 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:56.452094 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:56.458415 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:56.458898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:56.459371 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:56.460063 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:56.460515 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:56.460938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:56.588718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:56.597298 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:56.598748 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:56.599885 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-32d44b40-e8f5-4816-9a20-d7972c8d0285 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.152382 Aug 26 12:19:56.600638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 327/659] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:19:56 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:19:57.625050 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:57.625743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:57.633320 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:57.633820 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:57.634247 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:57.634939 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:57.635416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:57.635837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:57.768326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:57.776343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:57.777791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:57.778898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e19978a5-fcbf-4401-a270-56cc12007078 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.159292 Aug 26 12:19:57.779506 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 333/660] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:19:57 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:19:58.802143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:58.802753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:58.810103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:58.810589 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:58.811027 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:58.812003 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:58.812536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:58.812964 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:58.942760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:58.951266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:58.952957 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:19:58.954085 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-14f2acd3-6fdf-439c-b0cf-db2bdb421215 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.156102 Aug 26 12:19:58.954646 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 328/661] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:19:58 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:19:59.359227 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5e8422-7ad5-4229-813a-e37f09f2ad58"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:19:59.361504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:59.368177 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.368671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.369098 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:59.369775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.370217 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.370631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:59.450291 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Invalid volume: volume fb5e8422-7ad5-4229-813a-e37f09f2ad58 is already attached to instances: 44c064ae-bbc4-419e-adb2-2ad34d8a75de Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments HTTP/1.1 Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 74 Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:19:59.452671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {"volumeAttachment": {"volumeId": "fb5e8422-7ad5-4229-813a-e37f09f2ad58"}} Aug 26 12:19:59.454313 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Invalid volume: volume fb5e8422-7ad5-4229-813a-e37f09f2ad58 is already attached to instances: 44c064ae-bbc4-419e-adb2-2ad34d8a75de Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'server_id': '44c064ae-bbc4-419e-adb2-2ad34d8a75de', 'body': {'volumeAttachment': {'volumeId': 'fb5e8422-7ad5-4229-813a-e37f09f2ad58'}}} Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fb5e8422-7ad5-4229-813a-e37f09f2ad58 is already attached to instances: 44c064ae-bbc4-419e-adb2-2ad34d8a75de Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:59.455347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fb5e8422-7ad5-4229-813a-e37f09f2ad58 is already attached to instances: 44c064ae-bbc4-419e-adb2-2ad34d8a75de Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:19:59.456758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fb5e8422-7ad5-4229-813a-e37f09f2ad58 is already attached to instances: 44c064ae-bbc4-419e-adb2-2ad34d8a75de Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 400 to user: Invalid volume: volume fb5e8422-7ad5-4229-813a-e37f09f2ad58 is already attached to instances: 44c064ae-bbc4-419e-adb2-2ad34d8a75de {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe534fed-ab5d-4b32-b503-f95f74344719 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098947 Aug 26 12:19:59.458278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 334/662] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:19:59 2022] POST /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:19:59.520029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:59.520524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:59.526535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.527025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.527491 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:59.528306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.528792 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.529214 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:59.614923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'services' on Instance uuid 44c064ae-bbc4-419e-adb2-2ad34d8a75de {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:19:59.695383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1727fb8b-1fc3-431d-a407-ffd5c8ddca00 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments/fb5e8422-7ad5-4229-813a-e37f09f2ad58" status: 202 len: 0 microversion: 2.1 time: 0.179219 Aug 26 12:19:59.695979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 329/663] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:19:59 2022] DELETE /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments/fb5e8422-7ad5-4229-813a-e37f09f2ad58 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:19:59.706281 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:59.708821 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:59.716492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.717064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.717543 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:59.718244 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.718886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.720243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:59.750509 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:19:59.756672 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d350427-0274-4cf2-8d33-a0087f64dba1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056343 Aug 26 12:19:59.757229 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 335/664] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:19:59 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:19:59.977399 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:19:59.978779 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:19:59.985571 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.986058 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.986498 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:19:59.987197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:19:59.987675 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:19:59.988100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:00.120525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:00.128520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:00.129968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:00.131057 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b23cb456-6375-4a75-ad50-55c5c16b4fef tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.158381 Aug 26 12:20:00.131666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 330/665] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:19:59 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:00.726707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2004682744"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:00.727278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:00.729971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:00.736401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:00.736875 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:00.737306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:00.737986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:00.738434 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:00.739118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:00.769469 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:00.771713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:00.777676 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:00.778159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:00.778591 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:00.779301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:00.779751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:00.780975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:00.809788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-93b4122e-4391-45cb-b81c-98955dd5d985 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044205 Aug 26 12:20:00.810559 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 331/666] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:00 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 12:20:00.869369 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Removing security group 65dc0306-80d7-4bd7-a35d-0f40bfb4b0ad from port 23eb6509-4bf3-4d20-8514-4a082338c7ce Aug 26 12:20:00.877569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:00.878130 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:00.885723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:00.885723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:00.885723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:00.886261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:00.886716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:00.887358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:00.917307 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:20:01.016166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4e8ba248-8eeb-46f5-9ccc-270acdc2fdd6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 204 len: 0 microversion: 2.1 time: 0.141394 Aug 26 12:20:01.017056 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 332/667] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:20:00 2022] DELETE /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:20:01.091661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-02790b49-6724-4251-bcfe-ecb79c5af391 req-390661a1-d7a7-42b7-ae7f-ef8e5b7cb5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79b22dd-76aa-4cd2-814b-5d61b81a73bd", "name": "network-vif-plugged", "status": "completed", "tag": "6d70c9aa-09a0-4252-9c28-50bff97caa6f"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:01.100921 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-02790b49-6724-4251-bcfe-ecb79c5af391 req-390661a1-d7a7-42b7-ae7f-ef8e5b7cb5bf service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:01.101404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-02790b49-6724-4251-bcfe-ecb79c5af391 req-390661a1-d7a7-42b7-ae7f-ef8e5b7cb5bf service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:01.101839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-02790b49-6724-4251-bcfe-ecb79c5af391 req-390661a1-d7a7-42b7-ae7f-ef8e5b7cb5bf service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:01.112742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-02790b49-6724-4251-bcfe-ecb79c5af391 req-390661a1-d7a7-42b7-ae7f-ef8e5b7cb5bf service nova] Creating event network-vif-plugged:6d70c9aa-09a0-4252-9c28-50bff97caa6f for instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd on hv-cinder-84630 Aug 26 12:20:01.117980 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-02790b49-6724-4251-bcfe-ecb79c5af391 req-390661a1-d7a7-42b7-ae7f-ef8e5b7cb5bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095737 Aug 26 12:20:01.118728 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 333/668] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:01.124339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:01.125234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:01.131331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:01.131821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:01.132260 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:01.132958 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:01.133411 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:01.133837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:01.274981 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a5983579-ba33-4cd4-814f-affaf1c9cf0e tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/action" status: 202 len: 0 microversion: 2.1 time: 0.552190 Aug 26 12:20:01.278836 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 336/669] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:20:00 2022] POST /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 12:20:01.281169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:01.281843 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:01.288075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:01.288636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:01.289130 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:01.289892 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:01.291137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:01.291671 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:01.326008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:01.334657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c4223af0-42eb-4caf-8bf2-9abc8e01b53f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1682 microversion: 2.1 time: 0.214073 Aug 26 12:20:01.335508 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 334/670] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:01 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:01.340132 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-fe593b77-8861-45b0-9c8e-6bcc9fcfdf04 req-1fc09baa-6bff-4cfa-a84a-8d3213f3819e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636be5ae-16a1-4ef8-9d5e-649c32df46c2", "tag": "23eb6509-4bf3-4d20-8514-4a082338c7ce"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:01.354986 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe593b77-8861-45b0-9c8e-6bcc9fcfdf04 req-1fc09baa-6bff-4cfa-a84a-8d3213f3819e service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:01.355493 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe593b77-8861-45b0-9c8e-6bcc9fcfdf04 req-1fc09baa-6bff-4cfa-a84a-8d3213f3819e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:01.355927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe593b77-8861-45b0-9c8e-6bcc9fcfdf04 req-1fc09baa-6bff-4cfa-a84a-8d3213f3819e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:01.368716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-fe593b77-8861-45b0-9c8e-6bcc9fcfdf04 req-1fc09baa-6bff-4cfa-a84a-8d3213f3819e service nova] Creating event network-changed:23eb6509-4bf3-4d20-8514-4a082338c7ce for instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 on hv-cinder-84630 Aug 26 12:20:01.374691 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-fe593b77-8861-45b0-9c8e-6bcc9fcfdf04 req-1fc09baa-6bff-4cfa-a84a-8d3213f3819e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037060 Aug 26 12:20:01.375873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 335/671] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:01.461049 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:01.470608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:01.472102 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:01.473555 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f8f8fd2-c09a-4b53-81b6-b3ba446f1734 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.196940 Aug 26 12:20:01.474298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 337/672] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:01 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:02.320978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:02.321566 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:02.327702 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.328280 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.328787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.329543 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.330108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.330611 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.356204 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:02.356932 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:02.364829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.365309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.365738 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.366566 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.367101 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.367621 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.417694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lazy-loading 'services' on Instance uuid 636be5ae-16a1-4ef8-9d5e-649c32df46c2 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:20:02.526347 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:02.537478 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8234f70b-94f5-471c-a1ec-a4c79169f6a9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1682 microversion: 2.1 time: 0.184984 Aug 26 12:20:02.538254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 338/673] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:02 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:02.539986 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-329dba47-16bb-4d16-9254-b0bd1e35b3dd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "DELETE /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments/a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3" status: 202 len: 0 microversion: 2.1 time: 0.223705 Aug 26 12:20:02.544666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:02.545513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 336/674] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:20:02 2022] DELETE /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments/a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:20:02.547128 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:02.554955 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:02.559851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:02.564902 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.565381 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.565808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.566670 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.567311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.568009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.571619 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.572049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.572475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.573166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:02.573608 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:02.574030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:02.620138 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3a4ac06a-909a-4382-8a30-08e196f922bf tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069347 Aug 26 12:20:02.620882 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 337/675] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:02 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:20:02.721591 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:02.730833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:02.733689 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:02.735103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3dc1c842-6739-4739-802e-db1196279744 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.194027 Aug 26 12:20:02.735851 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 339/676] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:02 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:03.399826 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e29ab012-a9bf-41e8-807c-241e203b3c6d req-50a60a62-59a3-42df-857f-aa6e55f48233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636be5ae-16a1-4ef8-9d5e-649c32df46c2", "tag": "23eb6509-4bf3-4d20-8514-4a082338c7ce"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:03.406656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:03.424507 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e29ab012-a9bf-41e8-807c-241e203b3c6d req-50a60a62-59a3-42df-857f-aa6e55f48233 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:03.425004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e29ab012-a9bf-41e8-807c-241e203b3c6d req-50a60a62-59a3-42df-857f-aa6e55f48233 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:03.425444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e29ab012-a9bf-41e8-807c-241e203b3c6d req-50a60a62-59a3-42df-857f-aa6e55f48233 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:03.449769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e29ab012-a9bf-41e8-807c-241e203b3c6d req-50a60a62-59a3-42df-857f-aa6e55f48233 service nova] Creating event network-changed:23eb6509-4bf3-4d20-8514-4a082338c7ce for instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 on hv-cinder-84630 Aug 26 12:20:03.454705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e29ab012-a9bf-41e8-807c-241e203b3c6d req-50a60a62-59a3-42df-857f-aa6e55f48233 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059906 Aug 26 12:20:03.455599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 338/677] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:20:03.560407 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:03.561208 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:03.563280 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:03.564032 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:03.570487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:03.571073 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:03.571651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:03.572357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:03.573042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:03.573532 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:03.634927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:03.637243 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:03.657959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:03.658511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:03.658966 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:03.660483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:03.660742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:03.664573 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:03.698428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-86d21e41-464f-4778-b495-988008d77c88 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068007 Aug 26 12:20:03.699015 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 339/678] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:03 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:03.759840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:03.760548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:03.767536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:03.768234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:03.768755 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:03.769518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:03.770044 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:03.770537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:04.102108 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:04.110761 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db89bde1-6a32-480f-bbaf-fb4014633fef tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1682 microversion: 2.1 time: 0.554152 Aug 26 12:20:04.111466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 340/679] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:03 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1682 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:04.144287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:04.153614 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:04.156046 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:04.157289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-81922e2a-91f1-4d7a-bb4a-0442de64b555 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1407 microversion: 2.20 time: 0.401559 Aug 26 12:20:04.157934 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 340/680] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:03 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:20:04.711281 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:04.713617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:04.720246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:04.721044 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:04.721538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:04.722304 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:04.722819 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:04.723324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:04.770573 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a96d39d-596f-44fc-9fdc-85e1d4b0b387 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063040 Aug 26 12:20:04.776914 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 341/681] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:04 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:20:04.784698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:04.785829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:04.797664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:04.798358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:04.798863 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:04.801732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:04.802665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:04.803392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:04.857319 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:04.947300 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] HTTP exception thrown: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 is not attached to volume a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Request method failure captured: Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments/a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 HTTP/1.1 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLmnfw2B9FfZWbJ-iHFI2JAUiD3MGDMUkjunMrIsav2Lfdtj19cWFn3o1VA2HiiIfSb-uPaZolGvfaQwh-itL3tKH-Y0fc3FsvT0lS8PMfgUrzDdtJQ62H4s3_zpmYb7wxHparoB2NudtCNVe0xfShEX9wiX6RiqLGW9cLqY4u3S9T8 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 1f876d0f217a485392ddcbd79134f609 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestMinimumBasicScenario-938778627 Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:20:04.950025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f876d0f217a485392ddcbd79134f609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f876d0f217a485392ddcbd79134f609", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f876d0f217a485392ddcbd79134f609"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f876d0f217a485392ddcbd79134f609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestMinimumBasicScenario-938778627 Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 1f876d0f217a485392ddcbd79134f609 Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-938778627 Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-TestMinimumBasicScenario-938778627-project Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: ceed3909469f409189d9ed93937003f0 Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestMinimumBasicScenario-938778627-project Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:20:04.951666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 is not attached to volume a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '636be5ae-16a1-4ef8-9d5e-649c32df46c2', 'id': 'a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3'} Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3. Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:04.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 is not attached to volume a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 is not attached to volume a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:04.954580 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Returning 404 to user: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 is not attached to volume a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:04.956662 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-117ea812-837d-42fa-8735-3d6b990c9395 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "DELETE /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments/a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3" status: 404 len: 154 microversion: 2.1 time: 0.173142 Aug 26 12:20:04.956662 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 341/682] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:20:04 2022] DELETE /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2/os-volume_attachments/a6307cc7-f0ba-4232-93e3-0e5c3fe5bdc3 => generated 154 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:20:05.134178 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:05.134979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:05.142275 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.142985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.143615 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.144345 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.144960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.145412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.177232 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.177615 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.178040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.178476 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'fault' on Instance uuid 44c064ae-bbc4-419e-adb2-2ad34d8a75de {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:20:05.179490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:05.180101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:05.186757 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.187270 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.187710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.188481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.188931 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.189518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.223551 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:05.233816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e06d48e1-bd15-47b0-b3d0-3efe499dc3a5 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 200 len: 1332 microversion: 2.1 time: 0.103339 Aug 26 12:20:05.235401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 342/683] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:05 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:05.340379 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:05.349247 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:05.350707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:05.351901 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a60c1f1c-a440-4266-980a-6fa8714926fd tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1599 microversion: 2.20 time: 0.176456 Aug 26 12:20:05.352457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 342/684] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:05 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:20:05.375582 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:05.376157 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:05.382491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.383638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.384136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.385058 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.385504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.386085 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.472945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2980dcd3-5b1e-4ea1-8601-1253ed269dc4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102183 Aug 26 12:20:05.473615 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 343/685] 10.222.0.61 () {60 vars in 1316 bytes} [Fri Aug 26 12:20:05 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:20:05.503836 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0b19c09a-030d-4184-ae32-f2bd6827597d req-7b95522e-9f1f-4aeb-a4e8-06f87b2833ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44c064ae-bbc4-419e-adb2-2ad34d8a75de", "name": "network-vif-deleted", "tag": "e5b60208-99c9-44f8-8594-9d98d325d3dd"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:05.519005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b19c09a-030d-4184-ae32-f2bd6827597d req-7b95522e-9f1f-4aeb-a4e8-06f87b2833ab service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:05.519652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b19c09a-030d-4184-ae32-f2bd6827597d req-7b95522e-9f1f-4aeb-a4e8-06f87b2833ab service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:05.520208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0b19c09a-030d-4184-ae32-f2bd6827597d req-7b95522e-9f1f-4aeb-a4e8-06f87b2833ab service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:05.532673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0b19c09a-030d-4184-ae32-f2bd6827597d req-7b95522e-9f1f-4aeb-a4e8-06f87b2833ab service nova] Creating event network-vif-deleted:e5b60208-99c9-44f8-8594-9d98d325d3dd for instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de on hv-cinder-84630 Aug 26 12:20:05.538003 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0b19c09a-030d-4184-ae32-f2bd6827597d req-7b95522e-9f1f-4aeb-a4e8-06f87b2833ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Aug 26 12:20:05.538944 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 343/686] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:06.133228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:06.133729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:06.141391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:06.141930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:06.142362 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:06.143056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:06.143534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:06.143954 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:06.168800 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:20:06.245943 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fcfcf20e-2887-45c2-a10d-b3c02a0a5ff3 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "DELETE /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 204 len: 0 microversion: 2.1 time: 0.116687 Aug 26 12:20:06.246695 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 344/687] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:20:06 2022] DELETE /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:20:06.257372 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:06.258351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:06.261300 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:06.262015 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:06.266032 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:06.266638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:06.267364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:06.268262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:06.268450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:06.268936 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:06.269064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:06.269360 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:06.269661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:06.270080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:06.270698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:06.271305 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:06.285076 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de HTTP/1.1 Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:20:06.286729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:20:06.288121 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '44c064ae-bbc4-419e-adb2-2ad34d8a75de'} Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:06.288874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:20:06.290124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:06.291254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:06.291254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1925ca2f-6d10-4222-9d47-f599bea830ad tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 404 len: 111 microversion: 2.1 time: 0.031593 Aug 26 12:20:06.292195 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 345/688] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:06 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:20:06.296925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3b2f0ee-b099-4426-b312-984852981645 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '.version_select at 0x7ffa975c2ee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:06.316140 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3b2f0ee-b099-4426-b312-984852981645 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280716737" status: 202 len: 0 microversion: 2.1 time: 0.022896 Aug 26 12:20:06.316712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 346/689] 10.222.0.61 () {58 vars in 1221 bytes} [Fri Aug 26 12:20:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280716737 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:20:06.528976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:06.540093 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d42e050b-05d4-4e29-a2f1-23dc31bcc7f7 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1553 microversion: 2.1 time: 0.287283 Aug 26 12:20:06.540928 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 344/690] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:06 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:06.943507 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-535c4f1c-6e9b-489b-9e89-c530aa796d18 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: .version_select at 0x7ffa97582ee0>, body: {"keypair": {"name": "tempest-keypair-644567266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBe9EgU1jmCubu4cndcwht9fYxe2S0LSmRi2iCVnDTOUnrESEr4quKEi7E/kllHWv96EyTTG8vAfB6fK1iqHVFxm/Lnk8tjDmIZ5VwFPI3LBT5m2nsWqN45wUpnjhaO0Vw=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:06.959415 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-535c4f1c-6e9b-489b-9e89-c530aa796d18 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:20:06.963294 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-535c4f1c-6e9b-489b-9e89-c530aa796d18 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:20:06.985668 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-535c4f1c-6e9b-489b-9e89-c530aa796d18 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046251 Aug 26 12:20:06.986286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 347/691] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:20:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:20:07.566045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:07.567317 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:07.573837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:07.575289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:07.576090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:07.576843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:07.577302 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:07.577722 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:07.591257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e208393d-e56f-47fd-a5b4-8959a5c8c785 req-5151ad09-aaa9-467b-96d8-e46cc2882008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79b22dd-76aa-4cd2-814b-5d61b81a73bd", "tag": "6d70c9aa-09a0-4252-9c28-50bff97caa6f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:07.606625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e208393d-e56f-47fd-a5b4-8959a5c8c785 req-5151ad09-aaa9-467b-96d8-e46cc2882008 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:07.607583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e208393d-e56f-47fd-a5b4-8959a5c8c785 req-5151ad09-aaa9-467b-96d8-e46cc2882008 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:07.609169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e208393d-e56f-47fd-a5b4-8959a5c8c785 req-5151ad09-aaa9-467b-96d8-e46cc2882008 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:07.623865 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e208393d-e56f-47fd-a5b4-8959a5c8c785 req-5151ad09-aaa9-467b-96d8-e46cc2882008 service nova] Creating event network-changed:6d70c9aa-09a0-4252-9c28-50bff97caa6f for instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd on hv-cinder-84630 Aug 26 12:20:07.629102 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e208393d-e56f-47fd-a5b4-8959a5c8c785 req-5151ad09-aaa9-467b-96d8-e46cc2882008 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044336 Aug 26 12:20:07.629825 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 348/692] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:07.838586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:07.847301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6f0c5f00-8d5a-4848-ade5-704574fe9048 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1553 microversion: 2.1 time: 0.287144 Aug 26 12:20:07.848211 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 345/693] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:07 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:08.827322 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1601272437", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c7e62f88-9652-4f52-9fec-a02b6bfed4c3"}], "security_groups": [{"name": "tempest-securitygroup--1879456786"}], "key_name": "tempest-keypair-644567266", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:08.869668 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:08.870256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:08.876998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:08.877858 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:08.878294 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:08.878983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:08.879472 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:08.879891 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:09.017103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] validate_networks() for [('c7e62f88-9652-4f52-9fec-a02b6bfed4c3', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:20:09.191317 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ceed3909469f409189d9ed93937003f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f876d0f217a485392ddcbd79134f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:09.200426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ce7ff83a-9355-4ad4-80f0-a6564b9163b4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 200 len: 1553 microversion: 2.1 time: 0.334545 Aug 26 12:20:09.201156 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 346/694] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:08 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 1553 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:20:09.506067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:20:09.506535 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:20:09.507006 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:20:09.507491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:20:09.508025 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:20:09.517829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:09.518307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:09.518730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:09.519467 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:09.519911 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:09.520321 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:09.540205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:20:09.544247 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Getting quotas for user 36a27ca98a2e4521b269be48c9ec4cb0 and project 9574496fe7ba4144a05fca690cc3486f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:20:09.555609 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:20:09.558019 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:20:09.605271 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4cf7381-9cbc-4b6b-a11b-ebfbfa2f7020 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.783575 Aug 26 12:20:09.605918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 349/695] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:20:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 12:20:09.616968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3a4151e4-1a28-4d36-94ca-0c895a64f289 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:09.617435 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3a4151e4-1a28-4d36-94ca-0c895a64f289 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:09.619706 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:09.651835 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9d0fc460-591b-4826-b6ff-9d4daf6e18c5 req-5c55e333-09e3-4711-94f7-6741fbbe15e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636be5ae-16a1-4ef8-9d5e-649c32df46c2", "name": "network-vif-deleted", "tag": "23eb6509-4bf3-4d20-8514-4a082338c7ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:09.662728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9d0fc460-591b-4826-b6ff-9d4daf6e18c5 req-5c55e333-09e3-4711-94f7-6741fbbe15e8 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:09.663194 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9d0fc460-591b-4826-b6ff-9d4daf6e18c5 req-5c55e333-09e3-4711-94f7-6741fbbe15e8 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:09.663659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9d0fc460-591b-4826-b6ff-9d4daf6e18c5 req-5c55e333-09e3-4711-94f7-6741fbbe15e8 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:09.675160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9d0fc460-591b-4826-b6ff-9d4daf6e18c5 req-5c55e333-09e3-4711-94f7-6741fbbe15e8 service nova] Creating event network-vif-deleted:23eb6509-4bf3-4d20-8514-4a082338c7ce for instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 on hv-cinder-84630 Aug 26 12:20:09.680829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9d0fc460-591b-4826-b6ff-9d4daf6e18c5 req-5c55e333-09e3-4711-94f7-6741fbbe15e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033821 Aug 26 12:20:09.681737 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 350/696] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:20:09.682267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3a4151e4-1a28-4d36-94ca-0c895a64f289 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:09.690329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3a4151e4-1a28-4d36-94ca-0c895a64f289 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1241 microversion: 2.1 time: 0.077551 Aug 26 12:20:09.690916 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 347/697] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:09 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:10.223522 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:10.224250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] [instance: 636be5ae-16a1-4ef8-9d5e-649c32df46c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:10.230508 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:10.230991 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:10.231455 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:10.232145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:10.232596 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:10.233559 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:10.248225 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] HTTP exception thrown: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 could not be found. Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Request method failure captured: Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 HTTP/1.1 Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLmnfw2B9FfZWbJ-iHFI2JAUiD3MGDMUkjunMrIsav2Lfdtj19cWFn3o1VA2HiiIfSb-uPaZolGvfaQwh-itL3tKH-Y0fc3FsvT0lS8PMfgUrzDdtJQ62H4s3_zpmYb7wxHparoB2NudtCNVe0xfShEX9wiX6RiqLGW9cLqY4u3S9T8 Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 1f876d0f217a485392ddcbd79134f609 Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-TestMinimumBasicScenario-938778627 Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:20:10.251254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1f876d0f217a485392ddcbd79134f609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1f876d0f217a485392ddcbd79134f609", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f876d0f217a485392ddcbd79134f609"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1f876d0f217a485392ddcbd79134f609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-TestMinimumBasicScenario-938778627 Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 1f876d0f217a485392ddcbd79134f609 Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-938778627 Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-TestMinimumBasicScenario-938778627-project Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: ceed3909469f409189d9ed93937003f0 Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-TestMinimumBasicScenario-938778627-project Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 could not be found. Aug 26 12:20:10.253014 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '636be5ae-16a1-4ef8-9d5e-649c32df46c2'} Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 could not be found. Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:10.253858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 could not be found. Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 could not be found. Aug 26 12:20:10.255272 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:10.256384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Returning 404 to user: Instance 636be5ae-16a1-4ef8-9d5e-649c32df46c2 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:10.256384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b81d2be-9ea5-4a41-86ef-0254c609cde4 tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2" status: 404 len: 111 microversion: 2.1 time: 0.034614 Aug 26 12:20:10.256384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 351/698] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:10 2022] GET /compute/v2.1/servers/636be5ae-16a1-4ef8-9d5e-649c32df46c2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 12:20:10.262626 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-768e0e8f-243e-42ad-9eca-a8af51b173cd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] Calling method '.version_select at 0x7ffa978350d0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:10.283424 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-768e0e8f-243e-42ad-9eca-a8af51b173cd tempest-TestMinimumBasicScenario-938778627 tempest-TestMinimumBasicScenario-938778627-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1521648394" status: 202 len: 0 microversion: 2.1 time: 0.024526 Aug 26 12:20:10.283996 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 348/699] 10.222.0.61 () {58 vars in 1272 bytes} [Fri Aug 26 12:20:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1521648394 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 12:20:10.715655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:10.717021 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:10.727554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:10.729060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:10.730132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:10.731301 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:10.731781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:10.732858 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:10.828417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:10.837483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-62317a8b-e6be-42d8-9e95-357c966c8134 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1301 microversion: 2.1 time: 0.128766 Aug 26 12:20:10.838062 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 352/700] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:10 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1301 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:11.858996 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:11.859655 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:11.866249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:11.866749 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:11.867190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:11.867935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:11.868392 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:11.868822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:12.086202 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:12.097157 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5e31bfdc-2380-4b70-a6d3-7046267f0eb9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1367 microversion: 2.1 time: 0.243014 Aug 26 12:20:12.098130 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 349/701] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:11 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:12.329602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8e2103e2-681c-4174-b18d-64f143c2cd4f req-2724d9fa-e85e-4949-9f51-5b0f4006011e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377d03c5-57ad-4120-93c6-10a03315249d", "tag": "9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:12.345041 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e2103e2-681c-4174-b18d-64f143c2cd4f req-2724d9fa-e85e-4949-9f51-5b0f4006011e service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:12.345652 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e2103e2-681c-4174-b18d-64f143c2cd4f req-2724d9fa-e85e-4949-9f51-5b0f4006011e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:12.346080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e2103e2-681c-4174-b18d-64f143c2cd4f req-2724d9fa-e85e-4949-9f51-5b0f4006011e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:12.368218 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8e2103e2-681c-4174-b18d-64f143c2cd4f req-2724d9fa-e85e-4949-9f51-5b0f4006011e service nova] Creating event network-changed:9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27 for instance 377d03c5-57ad-4120-93c6-10a03315249d on hv-cinder-84630 Aug 26 12:20:12.374704 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8e2103e2-681c-4174-b18d-64f143c2cd4f req-2724d9fa-e85e-4949-9f51-5b0f4006011e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052692 Aug 26 12:20:12.376079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 353/702] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:13.118552 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:13.119416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:13.126991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:13.127725 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:13.128165 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:13.128869 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:13.129331 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:13.129884 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:13.267581 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:13.275324 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-64ab3183-513b-4731-914a-78dd765f2ea8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1367 microversion: 2.1 time: 0.160672 Aug 26 12:20:13.275906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 350/703] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:13 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:14.299595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:14.300404 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:14.308245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:14.308861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:14.309557 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:14.310302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:14.311611 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:14.312125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:14.644600 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:14.652231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6b82074-2f34-4039-a93a-a5fb8f4a9cf1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1367 microversion: 2.1 time: 0.358893 Aug 26 12:20:14.652806 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 354/704] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:14 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:15.674233 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:15.675790 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:15.682575 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:15.683121 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:15.683819 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:15.684524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:15.684974 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:15.685393 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:15.851433 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:15.860703 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-72551083-d6b8-4e29-a552-c4f8ff1b00e8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1367 microversion: 2.1 time: 0.191256 Aug 26 12:20:15.862909 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 351/705] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:15 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:16.883479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:16.884090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:16.890763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:16.891344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:16.891787 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:16.892485 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:16.892938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:16.893358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:17.070714 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3694a153-a725-43fc-af00-73654629dc46 req-9abc55c4-9395-4307-91fe-211ded7f5896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d03c5-57ad-4120-93c6-10a03315249d", "name": "network-vif-plugged", "status": "completed", "tag": "9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:17.083859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:17.094731 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-791a8c2f-31ca-4016-a26a-b424a9b4ae55 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1367 microversion: 2.1 time: 0.215142 Aug 26 12:20:17.097468 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3694a153-a725-43fc-af00-73654629dc46 req-9abc55c4-9395-4307-91fe-211ded7f5896 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:17.098253 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 355/706] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:16 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:17.112212 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3694a153-a725-43fc-af00-73654629dc46 req-9abc55c4-9395-4307-91fe-211ded7f5896 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:17.112996 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3694a153-a725-43fc-af00-73654629dc46 req-9abc55c4-9395-4307-91fe-211ded7f5896 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:17.126562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3694a153-a725-43fc-af00-73654629dc46 req-9abc55c4-9395-4307-91fe-211ded7f5896 service nova] Creating event network-vif-plugged:9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27 for instance 377d03c5-57ad-4120-93c6-10a03315249d on hv-cinder-84630 Aug 26 12:20:17.132234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3694a153-a725-43fc-af00-73654629dc46 req-9abc55c4-9395-4307-91fe-211ded7f5896 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065855 Aug 26 12:20:17.132916 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 352/707] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:18.122061 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:18.122698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:18.129247 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:18.129677 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:18.130107 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:18.130793 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:18.131267 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:18.131690 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:18.281759 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:18.289345 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-732e5d26-9134-4aca-b3e5-21dba6bfd87f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1367 microversion: 2.1 time: 0.171200 Aug 26 12:20:18.290241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 356/708] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:18 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:18.959555 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:18.960808 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:18.968230 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:18.969031 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:18.969661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:18.970644 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:18.971275 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:18.971824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:19.000030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-054babf3-f94e-4e9d-8ec3-7398e9bcb5dc tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/ips" status: 200 len: 146 microversion: 2.1 time: 0.045608 Aug 26 12:20:19.000625 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 353/709] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:20:18 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:19.310245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:19.311232 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:19.317863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:19.318384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:19.318760 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:19.319474 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:19.319924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:19.320341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:19.324460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:19.451050 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:19.459493 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19d65d7c-2918-45fc-bac3-786df10b351f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1557 microversion: 2.1 time: 0.153144 Aug 26 12:20:19.460053 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 357/710] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:19 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:19.480373 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:19.480833 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:19.486995 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:19.487517 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:19.487954 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:19.488894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:19.489350 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:19.489775 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:19.567636 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a2fae906-4a20-4462-89b9-d12bb1069b19 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091166 Aug 26 12:20:19.568244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 354/711] 10.222.0.61 () {58 vars in 1275 bytes} [Fri Aug 26 12:20:19 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:20.346377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ada6bef-8192-48c0-908e-e600d996db8f"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:20.348705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:20.350540 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:20.351410 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:20.357355 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:20.358568 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:20.359113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:20.359832 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:20.360293 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:20.360712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:20.483294 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:20.492520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-2a43bd61-87a7-4a49-adcf-672519fb1fdc req-d68537b6-33de-43ff-b808-bac72880a3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "377d03c5-57ad-4120-93c6-10a03315249d", "tag": "9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:20.504183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2a43bd61-87a7-4a49-adcf-672519fb1fdc req-d68537b6-33de-43ff-b808-bac72880a3cc service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:20.504672 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2a43bd61-87a7-4a49-adcf-672519fb1fdc req-d68537b6-33de-43ff-b808-bac72880a3cc service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:20.505107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2a43bd61-87a7-4a49-adcf-672519fb1fdc req-d68537b6-33de-43ff-b808-bac72880a3cc service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:20.517073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-2a43bd61-87a7-4a49-adcf-672519fb1fdc req-d68537b6-33de-43ff-b808-bac72880a3cc service nova] Creating event network-changed:9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27 for instance 377d03c5-57ad-4120-93c6-10a03315249d on hv-cinder-84630 Aug 26 12:20:20.522217 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-2a43bd61-87a7-4a49-adcf-672519fb1fdc req-d68537b6-33de-43ff-b808-bac72880a3cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040075 Aug 26 12:20:20.523000 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 355/712] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:20:20.622628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-131855bf-dc82-46d5-84c3-13b550f0a80d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280517 Aug 26 12:20:20.623586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 358/713] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:20:20 2022] POST /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:28.157870 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:28.160089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:28.166103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:28.166579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:28.167013 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:28.167730 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:28.168184 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:28.168601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:28.197033 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-15f06392-5036-446b-9359-ebdc21c12aaf tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Aug 26 12:20:28.197572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 356/714] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:28 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:28.209639 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:28.210209 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:28.216255 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:28.216728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:28.217154 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:28.217828 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:28.218489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:28.218929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:28.247334 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94a8287e-edf5-4574-ae53-fec2e7d5a91a tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/5ada6bef-8192-48c0-908e-e600d996db8f" status: 200 len: 194 microversion: 2.1 time: 0.042482 Aug 26 12:20:28.247888 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 359/715] 10.222.0.61 () {58 vars in 1413 bytes} [Fri Aug 26 12:20:28 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/5ada6bef-8192-48c0-908e-e600d996db8f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:29.572671 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0e51ee5-3188-429f-be53-1f134e448f7b"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:29.574949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:29.581670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:29.582181 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:29.582621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:29.583405 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:29.583861 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:29.584283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:29.700441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:29.703370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:29.709526 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:29.710008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:29.710611 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:29.711340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:29.711785 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:29.712205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:29.780125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42694b0c-5f16-4bcc-a37c-76d65131cb19 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "POST /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3/action" status: 200 len: 14 microversion: 2.1 time: 0.083710 Aug 26 12:20:29.781720 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 360/716] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:20:29 2022] POST /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 12:20:29.841429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e7587a44-a809-4e73-a94f-793b429b1ed9 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "POST /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272595 Aug 26 12:20:29.842241 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 357/717] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:20:29 2022] POST /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:30.854314 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:30.855230 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:30.857082 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-bffb40ef-ee46-4b06-9f37-50af48c74779 req-906dd37e-0f3a-4c1f-8cad-0cb2ebc537fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "633ef7a8-d96f-41b4-a43d-786fe1283ac3", "tag": "f6c2f93f-5bf1-4f62-84fc-fd77626a13bf"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:30.857992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:30.865441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:30.866211 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:30.866899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:30.867693 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:30.868381 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:30.868867 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:30.869033 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bffb40ef-ee46-4b06-9f37-50af48c74779 req-906dd37e-0f3a-4c1f-8cad-0cb2ebc537fe service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:30.869583 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bffb40ef-ee46-4b06-9f37-50af48c74779 req-906dd37e-0f3a-4c1f-8cad-0cb2ebc537fe service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:30.870251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bffb40ef-ee46-4b06-9f37-50af48c74779 req-906dd37e-0f3a-4c1f-8cad-0cb2ebc537fe service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:30.882005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-bffb40ef-ee46-4b06-9f37-50af48c74779 req-906dd37e-0f3a-4c1f-8cad-0cb2ebc537fe service nova] Creating event network-changed:f6c2f93f-5bf1-4f62-84fc-fd77626a13bf for instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 on hv-cinder-84630 Aug 26 12:20:30.887664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-bffb40ef-ee46-4b06-9f37-50af48c74779 req-906dd37e-0f3a-4c1f-8cad-0cb2ebc537fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035059 Aug 26 12:20:30.888265 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 358/718] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:30.897175 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:20:30.998354 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-792c214c-595b-4c73-b9c6-7bba520080a7 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "DELETE /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 204 len: 0 microversion: 2.1 time: 0.148069 Aug 26 12:20:31.003228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 361/719] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:20:30 2022] DELETE /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:20:31.009110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:31.009841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:31.016753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:31.017245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:31.017684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:31.018398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:31.018855 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:31.019315 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:31.173293 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:31.181085 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-957914bf-e19f-48f4-8055-070a550305fa tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1576 microversion: 2.1 time: 0.176697 Aug 26 12:20:31.181657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 359/720] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:31 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:20:32.203397 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:32.204088 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:32.210289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:32.210763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:32.211195 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:32.211898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:32.212369 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:32.212781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:32.374866 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:32.382612 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b049fab-e3a0-4de8-95b6-44f5919957cc tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1576 microversion: 2.1 time: 0.184068 Aug 26 12:20:32.383180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 362/721] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:32 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:33.368510 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-be26db2e-a357-4878-8382-f035253adfe4 req-bdad0141-23ac-47b1-94e7-d9cdaaf28faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "633ef7a8-d96f-41b4-a43d-786fe1283ac3", "name": "network-vif-deleted", "tag": "f6c2f93f-5bf1-4f62-84fc-fd77626a13bf"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:33.379453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-be26db2e-a357-4878-8382-f035253adfe4 req-bdad0141-23ac-47b1-94e7-d9cdaaf28faf service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:33.379934 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-be26db2e-a357-4878-8382-f035253adfe4 req-bdad0141-23ac-47b1-94e7-d9cdaaf28faf service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:33.380362 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-be26db2e-a357-4878-8382-f035253adfe4 req-bdad0141-23ac-47b1-94e7-d9cdaaf28faf service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:33.396427 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-be26db2e-a357-4878-8382-f035253adfe4 req-bdad0141-23ac-47b1-94e7-d9cdaaf28faf service nova] Creating event network-vif-deleted:f6c2f93f-5bf1-4f62-84fc-fd77626a13bf for instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 on hv-cinder-84630 Aug 26 12:20:33.404725 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-be26db2e-a357-4878-8382-f035253adfe4 req-bdad0141-23ac-47b1-94e7-d9cdaaf28faf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039763 Aug 26 12:20:33.405746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:33.406310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 360/722] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:33.407530 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:33.414395 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:33.415669 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:33.416442 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:33.417556 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:33.417765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:33.418182 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:33.486140 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b51cd55973a419cad6311609395bb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ca4bc65af4f25afb8456f32378173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:33.494037 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dff9dab4-9004-41d5-8f31-33d0db608919 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 200 len: 1225 microversion: 2.1 time: 0.093042 Aug 26 12:20:33.494587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 363/723] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:33 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:34.517103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:34.517826 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] [instance: 633ef7a8-d96f-41b4-a43d-786fe1283ac3] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:34.523851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:34.524329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:34.524794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:34.525490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:34.525937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:34.526353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:34.540510 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] HTTP exception thrown: Instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 could not be found. Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Request method failure captured: Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 HTTP/1.1 Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLlu6kmjAxSmdjIr-K2Zv67HpZWLuCDDmVv9GiVKk8duXIewC3SOof1owp9UmmiKTG5HQKqk6huc40MsSq0gAH7pquQ1N536NBnqaJ5j5XINuHhL2Tao0rYxX824TuJbKFruTvxp2prvmrJZ6hePVT_pN1Qcwqkl1-drHqmglv3PRZs Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 293ca4bc65af4f25afb8456f32378173 Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-1308906433 Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:20:34.542109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/293ca4bc65af4f25afb8456f32378173"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_293ca4bc65af4f25afb8456f32378173", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/293ca4bc65af4f25afb8456f32378173"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/293ca4bc65af4f25afb8456f32378173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-1308906433 Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 293ca4bc65af4f25afb8456f32378173 Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-1308906433 Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-1308906433-project Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 2b51cd55973a419cad6311609395bb89 Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-1308906433-project Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 could not be found. Aug 26 12:20:34.543780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '633ef7a8-d96f-41b4-a43d-786fe1283ac3'} Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 could not be found. Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:34.544910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 could not be found. Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 could not be found. Aug 26 12:20:34.546652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:34.548054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Returning 404 to user: Instance 633ef7a8-d96f-41b4-a43d-786fe1283ac3 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:34.548054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f7e9068a-f468-484b-8fc5-f1600ff03808 tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3" status: 404 len: 111 microversion: 2.1 time: 0.031530 Aug 26 12:20:34.548054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 361/724] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:34 2022] GET /compute/v2.1/servers/633ef7a8-d96f-41b4-a43d-786fe1283ac3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:20:35.829847 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7f8a11c0-d15c-4384-bad1-8de99891987a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] Calling method '.version_select at 0x7ffa97607ee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:35.853019 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7f8a11c0-d15c-4384-bad1-8de99891987a tempest-TestVolumeBootPattern-1308906433 tempest-TestVolumeBootPattern-1308906433-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-904552570" status: 202 len: 0 microversion: 2.1 time: 0.027859 Aug 26 12:20:35.854376 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 364/725] 10.222.0.61 () {58 vars in 1260 bytes} [Fri Aug 26 12:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-904552570 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:20:37.391568 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:37.393831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:37.401783 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:37.402282 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:37.402721 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:37.403447 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:37.403904 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:37.404325 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:37.408485 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:37.439269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4f47c362-5750-4dc6-ba85-3141f0351ecd tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052082 Aug 26 12:20:37.439927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 362/726] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:37 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:37.592225 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:37.593273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:37.600056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:37.600625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:37.601114 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:37.601868 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:37.602384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:37.602884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:37.633197 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d230ae19-f83f-433b-9cb3-0e314db6024d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/5ada6bef-8192-48c0-908e-e600d996db8f" status: 200 len: 194 microversion: 2.1 time: 0.045458 Aug 26 12:20:37.633892 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 365/727] 10.222.0.61 () {58 vars in 1413 bytes} [Fri Aug 26 12:20:37 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/5ada6bef-8192-48c0-908e-e600d996db8f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:37.645781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:37.646279 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:37.652813 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:37.653586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:37.654098 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:37.654878 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:37.655769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:37.656474 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:37.743586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lazy-loading 'services' on Instance uuid 938ea034-600f-4b82-a62a-38d5a319a78f {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:20:37.819647 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7056565e-be67-4aa7-95f0-d0c49fb49ae2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/5ada6bef-8192-48c0-908e-e600d996db8f" status: 202 len: 0 microversion: 2.1 time: 0.178221 Aug 26 12:20:37.820239 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 363/728] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:20:37 2022] DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/5ada6bef-8192-48c0-908e-e600d996db8f => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 12:20:38.972943 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:38.974133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:38.985845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:38.986411 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:38.987703 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:38.988894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:38.989348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:38.993090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:39.023505 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de428b87-3864-4c34-b0d2-183429195b34 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/f0e51ee5-3188-429f-be53-1f134e448f7b" status: 200 len: 194 microversion: 2.1 time: 0.055864 Aug 26 12:20:39.024174 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 366/729] 10.222.0.61 () {58 vars in 1413 bytes} [Fri Aug 26 12:20:38 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/f0e51ee5-3188-429f-be53-1f134e448f7b => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:39.036452 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:39.037160 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:39.043385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:39.043961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:39.044468 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:39.045261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:39.045827 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:39.046426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:39.128086 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lazy-loading 'services' on Instance uuid 938ea034-600f-4b82-a62a-38d5a319a78f {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:20:39.200417 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bb95c4aa-42e1-45be-9cd7-a78de4ed25ed tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/f0e51ee5-3188-429f-be53-1f134e448f7b" status: 202 len: 0 microversion: 2.1 time: 0.168760 Aug 26 12:20:39.201023 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 364/730] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:20:39 2022] DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments/f0e51ee5-3188-429f-be53-1f134e448f7b => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:20:40.383142 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:40.385227 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:40.391600 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.392024 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.392458 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.393147 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.393773 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.394205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.423091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17d178c9-bd6f-4d25-b6f3-e73eb80375c7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043910 Aug 26 12:20:40.423673 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 367/731] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:40 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 26 12:20:40.537072 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:40.539420 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:40.541328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:40.548180 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.548661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.549090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.549780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.550225 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.550639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.580284 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a87a1958-a4ce-47b7-b193-00ed455d796b tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048024 Aug 26 12:20:40.580845 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 365/732] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:20:40 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 12:20:40.647166 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:40.647609 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:40.654107 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.654590 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.655018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.656268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.656715 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.657323 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.683464 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:20:40.774417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22a9a885-e7d8-4645-b76a-8868bf443d20 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 204 len: 0 microversion: 2.1 time: 0.130784 Aug 26 12:20:40.786543 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:40.787353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:40.791114 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 368/733] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:20:40 2022] DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:20:40.798621 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.799838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.800468 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.801397 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:40.802021 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:40.802608 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:40.944989 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:40.954019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e2bc1099-2024-4605-9210-1b0f379134cb tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1673 microversion: 2.1 time: 0.172429 Aug 26 12:20:40.954686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 366/734] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:40 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:41.979628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:41.980697 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:41.996370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:41.996859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:41.997750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:41.998683 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:42.003454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:42.019340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:42.256686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:42.266431 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c85a4a5b-a609-49d6-a416-6bfaebbf71a2 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1673 microversion: 2.1 time: 0.293247 Aug 26 12:20:42.284190 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 369/735] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:41 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1673 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:43.294134 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:43.295489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:43.305993 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:43.306511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:43.307106 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:43.308585 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:43.309548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:43.310245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:43.393186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d9f1a5e4e77467f8a691b634a841de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99e42555cbcd4716a1be1075f4a2b3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:43.401922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1c531e2c-de17-4d6a-a021-e926e6a89cba tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 200 len: 1606 microversion: 2.1 time: 0.112050 Aug 26 12:20:43.402513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 367/736] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:43 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 1606 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:20:43.595304 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-297fabc8-16e0-4f70-ad10-a2e5259565d3 req-ef2d6cea-370f-4b7f-88c5-5148e5aaaeec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938ea034-600f-4b82-a62a-38d5a319a78f", "name": "network-vif-deleted", "tag": "fbd0f5f7-c070-4ecf-9981-fdeb97928cf5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:43.605438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-297fabc8-16e0-4f70-ad10-a2e5259565d3 req-ef2d6cea-370f-4b7f-88c5-5148e5aaaeec service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:43.606040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-297fabc8-16e0-4f70-ad10-a2e5259565d3 req-ef2d6cea-370f-4b7f-88c5-5148e5aaaeec service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:43.606960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-297fabc8-16e0-4f70-ad10-a2e5259565d3 req-ef2d6cea-370f-4b7f-88c5-5148e5aaaeec service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:43.621634 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-297fabc8-16e0-4f70-ad10-a2e5259565d3 req-ef2d6cea-370f-4b7f-88c5-5148e5aaaeec service nova] Creating event network-vif-deleted:fbd0f5f7-c070-4ecf-9981-fdeb97928cf5 for instance 938ea034-600f-4b82-a62a-38d5a319a78f on hv-cinder-84630 Aug 26 12:20:43.627305 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-297fabc8-16e0-4f70-ad10-a2e5259565d3 req-ef2d6cea-370f-4b7f-88c5-5148e5aaaeec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036990 Aug 26 12:20:43.628316 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 370/737] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:44.423987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:44.424592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:44.430995 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:44.431519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:44.431949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:44.432666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:44.433110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:44.433524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:44.447279 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] HTTP exception thrown: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Request method failure captured: Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f HTTP/1.1 Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkZFLELr4TWwCaIR1iMNUm2smvd_LO2wPqlgXVHsQ-Cc467PNUcVJ1Yv4F7HwDbORpVK78mIvYmMNswkoXjeXMhywJvPuPTCK4NhJuifE2YrfuGII1tadiG_6-TlZ5uUIbM3eXkrm3VuDR3fcExRaQLvgFirD5hhzcvCnBNkzXLQVM Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:20:44.448877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_99e42555cbcd4716a1be1075f4a2b3b1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 2d9f1a5e4e77467f8a691b634a841de2 Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:44.450444 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '938ea034-600f-4b82-a62a-38d5a319a78f'} Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:44.451272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:44.453172 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:44.454297 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Returning 404 to user: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:44.454297 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0759ccab-9c64-4b01-a8ab-0f934d38e353 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 404 len: 111 microversion: 2.1 time: 0.030443 Aug 26 12:20:44.454297 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 368/738] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:44 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:20:44.460986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3fc98edf-9225-4bc8-bf0d-345a533d8041 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '.version_select at 0x7ffa975859d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:44.480180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3fc98edf-9225-4bc8-bf0d-345a533d8041 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037415154" status: 202 len: 0 microversion: 2.1 time: 0.023349 Aug 26 12:20:44.480766 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 371/739] 10.222.0.61 () {58 vars in 1221 bytes} [Fri Aug 26 12:20:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037415154 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 26 12:20:47.369551 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:47.370073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:47.376900 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:47.377382 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:47.377816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:47.378503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:47.378952 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:47.379416 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:47.393367 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] HTTP exception thrown: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Request method failure captured: Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f HTTP/1.1 Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkZFLELr4TWwCaIR1iMNUm2smvd_LO2wPqlgXVHsQ-Cc467PNUcVJ1Yv4F7HwDbORpVK78mIvYmMNswkoXjeXMhywJvPuPTCK4NhJuifE2YrfuGII1tadiG_6-TlZ5uUIbM3eXkrm3VuDR3fcExRaQLvgFirD5hhzcvCnBNkzXLQVM Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:20:47.394875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_99e42555cbcd4716a1be1075f4a2b3b1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 2d9f1a5e4e77467f8a691b634a841de2 Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.396544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '938ea034-600f-4b82-a62a-38d5a319a78f'} Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:47.397360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.398681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.400087 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Returning 404 to user: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:47.400087 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c3d2ec0b-5c2b-4c9d-b335-bed58d8fcf05 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 404 len: 111 microversion: 2.1 time: 0.030524 Aug 26 12:20:47.400087 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 369/740] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:20:47 2022] DELETE /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 12:20:47.405359 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:47.406168 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: 938ea034-600f-4b82-a62a-38d5a319a78f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:47.412113 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:47.412593 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:47.413017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:47.413688 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:47.414133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:47.414545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:47.419585 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:20:47.428951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] HTTP exception thrown: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Request method failure captured: Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f HTTP/1.1 Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkZFLELr4TWwCaIR1iMNUm2smvd_LO2wPqlgXVHsQ-Cc467PNUcVJ1Yv4F7HwDbORpVK78mIvYmMNswkoXjeXMhywJvPuPTCK4NhJuifE2YrfuGII1tadiG_6-TlZ5uUIbM3eXkrm3VuDR3fcExRaQLvgFirD5hhzcvCnBNkzXLQVM Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:20:47.430779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_99e42555cbcd4716a1be1075f4a2b3b1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 2d9f1a5e4e77467f8a691b634a841de2 Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.432401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '938ea034-600f-4b82-a62a-38d5a319a78f'} Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:47.433251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. Aug 26 12:20:47.435192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:47.437145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Returning 404 to user: Instance 938ea034-600f-4b82-a62a-38d5a319a78f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:47.437145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa56a71e-39b1-4cf2-ba0d-bd5bc4a0d525 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f" status: 404 len: 111 microversion: 2.1 time: 0.031343 Aug 26 12:20:47.437145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 372/741] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:47 2022] GET /compute/v2.1/servers/938ea034-600f-4b82-a62a-38d5a319a78f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:20:48.569067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:48.569578 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:48.576033 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:48.576513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:48.577582 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:48.578494 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:48.578949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:48.579417 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:48.592474 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] HTTP exception thrown: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Request method failure captured: Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 HTTP/1.1 Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkZFLELr4TWwCaIR1iMNUm2smvd_LO2wPqlgXVHsQ-Cc467PNUcVJ1Yv4F7HwDbORpVK78mIvYmMNswkoXjeXMhywJvPuPTCK4NhJuifE2YrfuGII1tadiG_6-TlZ5uUIbM3eXkrm3VuDR3fcExRaQLvgFirD5hhzcvCnBNkzXLQVM Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:20:48.594522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_99e42555cbcd4716a1be1075f4a2b3b1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 2d9f1a5e4e77467f8a691b634a841de2 Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.596133 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': 'c6221ce4-7d73-44fa-a573-5d3b3146b9d8'} Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:48.597269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.598843 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.600499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Returning 404 to user: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:48.600499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5fd51f51-15d4-4bcf-9cf9-694a559c9a1d tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 404 len: 111 microversion: 2.1 time: 0.030726 Aug 26 12:20:48.600499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 370/742] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:20:48 2022] DELETE /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:20:48.604163 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:48.604790 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] [instance: c6221ce4-7d73-44fa-a573-5d3b3146b9d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:48.611925 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:48.612399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:48.612827 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:48.613766 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:48.614215 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:48.614633 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:48.628329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] HTTP exception thrown: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Request method failure captured: Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 HTTP/1.1 Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkZFLELr4TWwCaIR1iMNUm2smvd_LO2wPqlgXVHsQ-Cc467PNUcVJ1Yv4F7HwDbORpVK78mIvYmMNswkoXjeXMhywJvPuPTCK4NhJuifE2YrfuGII1tadiG_6-TlZ5uUIbM3eXkrm3VuDR3fcExRaQLvgFirD5hhzcvCnBNkzXLQVM Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:20:48.629830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_99e42555cbcd4716a1be1075f4a2b3b1", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/99e42555cbcd4716a1be1075f4a2b3b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 99e42555cbcd4716a1be1075f4a2b3b1 Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1485836120 Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 2d9f1a5e4e77467f8a691b634a841de2 Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1485836120-project Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.631520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'c6221ce4-7d73-44fa-a573-5d3b3146b9d8'} Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:20:48.632631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. Aug 26 12:20:48.634083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:20:48.635527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] Returning 404 to user: Instance c6221ce4-7d73-44fa-a573-5d3b3146b9d8 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:20:48.635527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8379984-3a13-4e4e-ad65-2f1457970ff7 tempest-AttachVolumeTestJSON-1485836120 tempest-AttachVolumeTestJSON-1485836120-project] 10.222.0.61 "GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8" status: 404 len: 111 microversion: 2.1 time: 0.030789 Aug 26 12:20:48.635527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 373/743] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:20:48 2022] GET /compute/v2.1/servers/c6221ce4-7d73-44fa-a573-5d3b3146b9d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:20:50.179692 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:50.180251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:50.186880 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:50.187464 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:50.187900 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:50.188600 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:50.189049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:50.189472 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:50.212232 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f0be348f-680c-46c8-9c9a-46cdf424a0fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/ips" status: 200 len: 152 microversion: 2.20 time: 0.036398 Aug 26 12:20:50.212807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 371/744] 10.222.0.61 () {60 vars in 1289 bytes} [Fri Aug 26 12:20:50 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:20:52.045125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:52.046488 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:52.053470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:52.054203 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:52.054630 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:52.055519 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:52.056126 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:52.056826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:52.086449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lazy-loading 'flavor' on Instance uuid f79b22dd-76aa-4cd2-814b-5d61b81a73bd {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:20:52.278549 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2496c21b-2785-46d4-93c1-70bf4beafff2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/action" status: 202 len: 0 microversion: 2.20 time: 0.237201 Aug 26 12:20:52.279143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 374/745] 10.222.0.61 () {62 vars in 1319 bytes} [Fri Aug 26 12:20:52 2022] POST /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:20:52.288723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:52.289335 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:52.296483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:52.297155 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:52.297672 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:52.298551 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:52.299234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:52.299668 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:52.440585 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:52.448719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:52.450180 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:52.451360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-41794fd7-a88a-4d5f-8b40-4407c2a9acc1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.167806 Aug 26 12:20:52.452139 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 372/746] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:52 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:53.475592 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:53.476293 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:53.482663 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:53.483912 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:53.484379 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:53.485097 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:53.485574 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:53.485997 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:53.619280 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:53.627975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:53.629434 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:53.630731 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2ac5186-85c2-4747-b595-25680b0244c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.160139 Aug 26 12:20:53.631308 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 375/747] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:53 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:54.653640 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:54.654252 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:54.672597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:54.673018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:54.673453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:54.674183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:54.674628 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:54.675727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:54.808398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:54.817407 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:54.818872 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:54.820067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1119ab74-9db0-453a-95e2-42ea83b38057 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.170431 Aug 26 12:20:54.820622 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 373/748] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:54 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:55.844542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:55.845146 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:55.851883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:55.852360 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:55.852794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:55.853471 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:55.853917 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:55.854330 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:55.992637 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:56.001852 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:56.003346 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:56.004505 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4bdf901e-e3b8-435c-ad5c-0953542ae67c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.165025 Aug 26 12:20:56.005050 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 376/749] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:55 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:56.594608 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:56.595187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:56.601591 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:56.602077 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:56.602581 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:56.603312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:56.603768 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:56.604197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:56.628187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-215373f1-6bcb-4804-9312-a93c7c73ec03 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/ips" status: 200 len: 150 microversion: 2.1 time: 0.038087 Aug 26 12:20:56.628764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 374/750] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:20:56 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:57.026736 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:57.027363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:57.034487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:57.034960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:57.035425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:57.036105 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:57.036546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:57.037022 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:57.166550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:57.174989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:57.176500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:57.177647 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb31ef26-e08d-43c7-9b27-9846d8979d4d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.154828 Aug 26 12:20:57.178198 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 377/751] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:57 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:20:57.980661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f239ce-b3ba-42e8-8552-57aca33242b1"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:20:57.983832 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:57.990680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:57.991196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:57.991657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:57.992423 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:57.992895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:57.993313 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:58.201105 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:58.202226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:58.208820 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:58.209310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:58.209777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:58.210510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:58.210963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:58.211430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:58.229283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d198b6e3-bcf0-4ebc-af66-1ec7121f38e6 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "POST /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252367 Aug 26 12:20:58.230107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 375/752] 10.222.0.61 () {60 vars in 1323 bytes} [Fri Aug 26 12:20:57 2022] POST /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:20:58.352897 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:58.361299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:58.362750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:58.364226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edbf329f-dca0-4b1e-90f6-a27610cf0c9e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.166971 Aug 26 12:20:58.364784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 378/753] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:58 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:20:59.387138 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:20:59.387862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:20:59.394448 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:59.394927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:59.395387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:59.396066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:20:59.396510 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:20:59.396926 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:20:59.525004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:59.533544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:59.534983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:20:59.536154 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ff83734e-af4c-4373-93b6-af51ae6d8b22 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.153358 Aug 26 12:20:59.536698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 376/754] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:20:59 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:00.560241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:00.560897 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:00.567559 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:00.568042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:00.568470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:00.569152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:00.569627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:00.570039 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:00.698636 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:00.709547 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:00.711504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:00.712585 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-115b585c-5dc8-477c-ac6b-3001f5a9daea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.156158 Aug 26 12:21:00.713439 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 379/755] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:00 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:01.736663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:01.737202 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:01.743931 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:01.744411 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:01.745385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:01.745521 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:01.745967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:01.746381 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:01.878323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:01.886346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:01.887868 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:01.889164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-76445030-a5b3-4ed4-a8fb-88d6d714ccba tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.156989 Aug 26 12:21:01.890041 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 377/756] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:01 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:02.911944 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:02.912541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:02.915056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:02.921234 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:02.921704 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:02.922131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:02.922802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:02.923269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:02.923682 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:03.051394 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:03.059392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:03.060955 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:03.062232 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-751e548a-6ada-46ac-9caa-b04f18c74da0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1745 microversion: 2.20 time: 0.154095 Aug 26 12:21:03.062777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 380/757] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:02 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:04.085298 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:04.085847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:04.092916 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:04.093422 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:04.093852 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:04.094534 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:04.094979 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:04.095429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:04.232163 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:04.234553 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:04.242025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:04.243609 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:04.244825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4280f009-ac22-4a3f-a8f3-a0b8dca7a8d2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1745 microversion: 2.20 time: 0.163486 Aug 26 12:21:04.245449 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 378/758] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:04 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:04.827929 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:04.828465 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:04.834886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:04.835414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:04.835852 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:04.836604 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:04.836979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:04.837401 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:04.933918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'services' on Instance uuid 377d03c5-57ad-4120-93c6-10a03315249d {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:21:05.034824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3585f8f-3fa4-4897-b0b8-3f540ad80a6f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments/08f239ce-b3ba-42e8-8552-57aca33242b1" status: 202 len: 0 microversion: 2.1 time: 0.211468 Aug 26 12:21:05.035461 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 381/759] 10.222.0.61 () {58 vars in 1416 bytes} [Fri Aug 26 12:21:04 2022] DELETE /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments/08f239ce-b3ba-42e8-8552-57aca33242b1 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:21:05.045060 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:05.047828 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:05.055367 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:05.055925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:05.056410 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:05.057199 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:05.057934 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:05.058339 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:05.089762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d6a4c7bb-72c1-4d03-abb7-7af26f7ac3e3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049757 Aug 26 12:21:05.090499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 379/760] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:21:05 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:05.269684 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:05.270327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:05.276883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:05.277363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:05.277800 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:05.278489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:05.278947 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:05.279399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:05.339777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8db850b0-e49a-4fef-8519-3e11fff50b63 req-1d97a3db-86d5-4c25-9392-c0f47c64aa32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79b22dd-76aa-4cd2-814b-5d61b81a73bd", "name": "network-vif-plugged", "status": "completed", "tag": "6d70c9aa-09a0-4252-9c28-50bff97caa6f"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:05.349822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8db850b0-e49a-4fef-8519-3e11fff50b63 req-1d97a3db-86d5-4c25-9392-c0f47c64aa32 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:05.350286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8db850b0-e49a-4fef-8519-3e11fff50b63 req-1d97a3db-86d5-4c25-9392-c0f47c64aa32 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:05.350886 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8db850b0-e49a-4fef-8519-3e11fff50b63 req-1d97a3db-86d5-4c25-9392-c0f47c64aa32 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:05.363002 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8db850b0-e49a-4fef-8519-3e11fff50b63 req-1d97a3db-86d5-4c25-9392-c0f47c64aa32 service nova] Creating event network-vif-plugged:6d70c9aa-09a0-4252-9c28-50bff97caa6f for instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd on hv-cinder-84630 Aug 26 12:21:05.368441 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8db850b0-e49a-4fef-8519-3e11fff50b63 req-1d97a3db-86d5-4c25-9392-c0f47c64aa32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032559 Aug 26 12:21:05.369118 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 380/761] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:21:05.415065 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:05.423393 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:05.424847 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:05.425993 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-30ad9ace-9f02-4a36-b921-0f15451053b3 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.160590 Aug 26 12:21:05.426547 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 382/762] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:05 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:06.104151 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:06.106732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:06.117018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.117792 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.118391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.119291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.119898 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.120477 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.156616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d4e509e7-0569-433e-9e56-cf8d340d819f tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057916 Aug 26 12:21:06.157665 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 381/763] 10.222.0.61 () {58 vars in 1302 bytes} [Fri Aug 26 12:21:06 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 26 12:21:06.239602 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:06.240764 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:06.248320 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.249180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.249877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.250785 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.252586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.253080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.289276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:21:06.410438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d81fee1-748f-4d3c-ad6c-d39248e7ace1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 204 len: 0 microversion: 2.1 time: 0.175137 Aug 26 12:21:06.422236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:06.422850 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:06.426589 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 383/764] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:21:06 2022] DELETE /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 26 12:21:06.431419 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.431919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.432347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.433744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.434907 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.435742 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.450579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:06.452656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:06.473111 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.473850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.474492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.476170 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:06.476786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:06.477364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:06.659404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:06.671524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-894f500e-7f7b-4806-b579-8b7c015a1197 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1682 microversion: 2.1 time: 0.254954 Aug 26 12:21:06.672861 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 382/765] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:06 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1682 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:21:06.692405 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:06.702361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:06.704917 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:06.706119 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ccd5e9ca-44dd-4516-938f-805918308483 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.260656 Aug 26 12:21:06.707130 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 384/766] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:06 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:07.693824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:07.694438 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:07.701086 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:07.702185 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:07.702745 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:07.703466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:07.704079 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:07.704670 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:07.730254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:07.730887 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:07.738086 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:07.738931 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:07.751531 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:07.752484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:07.753100 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:07.753635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:07.915487 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:07.925231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e6ea9f0c-029a-4d9e-b27d-8aff8ebb9e6a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1682 microversion: 2.1 time: 0.235635 Aug 26 12:21:07.926038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 383/767] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:07 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1682 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:21:07.943747 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:07.947542 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:07.955340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:07.957017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:07.958275 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9b75bdbe-35ec-48f2-94b9-0c0d82101b43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.232275 Aug 26 12:21:07.958914 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 385/768] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:07 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:08.951024 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:08.953255 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:08.976310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:08.980606 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:08.981686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:08.982469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:08.984251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:08.985505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:08.988075 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:08.989584 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:09.000070 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:09.000637 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:09.004736 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:09.005837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:09.007053 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:09.008096 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:09.084655 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:09.096406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4b0f43f8-32c1-4878-b1e9-e72761ed5bd3 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1614 microversion: 2.1 time: 0.149323 Aug 26 12:21:09.097950 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 384/769] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:08 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1614 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:21:09.408287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8e3ba7ad-15d8-45a3-9717-566a7d6d8f40 req-52658cf2-0a53-4e13-829b-5448365db76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "377d03c5-57ad-4120-93c6-10a03315249d", "name": "network-vif-deleted", "tag": "9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:09.422498 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8e3ba7ad-15d8-45a3-9717-566a7d6d8f40 req-52658cf2-0a53-4e13-829b-5448365db76e service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:09.424131 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8e3ba7ad-15d8-45a3-9717-566a7d6d8f40 req-52658cf2-0a53-4e13-829b-5448365db76e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:09.424744 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8e3ba7ad-15d8-45a3-9717-566a7d6d8f40 req-52658cf2-0a53-4e13-829b-5448365db76e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:09.448346 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:09.457205 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8e3ba7ad-15d8-45a3-9717-566a7d6d8f40 req-52658cf2-0a53-4e13-829b-5448365db76e service nova] Creating event network-vif-deleted:9cf4b1d1-4f14-4ce5-a892-9fc14ce63a27 for instance 377d03c5-57ad-4120-93c6-10a03315249d on hv-cinder-84630 Aug 26 12:21:09.466491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:09.473050 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8e3ba7ad-15d8-45a3-9717-566a7d6d8f40 req-52658cf2-0a53-4e13-829b-5448365db76e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069026 Aug 26 12:21:09.476659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:09.479333 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 385/770] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:21:09.480758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a32d9889-0fed-48d6-b23a-0139ac40ad33 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.500831 Aug 26 12:21:09.482245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 386/771] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:08 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:10.122174 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:10.124955 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:10.143740 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:10.150509 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:10.152047 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:10.153191 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:10.157075 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:10.161707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:10.217750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:10.218911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:10.219911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:10.221110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lazy-loading 'fault' on Instance uuid 377d03c5-57ad-4120-93c6-10a03315249d {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:21:10.302460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a27ca98a2e4521b269be48c9ec4cb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9574496fe7ba4144a05fca690cc3486f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:10.313749 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6391aa1d-1516-4b84-a258-89ef4335c2fb tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 200 len: 1331 microversion: 2.1 time: 0.198261 Aug 26 12:21:10.328775 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 386/772] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:10 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 1331 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:21:10.512742 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:10.513346 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:10.531277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:10.531774 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:10.534319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:10.535375 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:10.536040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:10.536666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:10.740890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:10.762727 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:10.766035 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:10.767500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-abf9f1a4-289a-4d89-9624-a6e90b01a610 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.258787 Aug 26 12:21:10.768367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 387/773] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:10 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:11.337180 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:11.337707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:11.344740 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=46 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:11.346441 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:11.346926 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:11.347587 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:11.348449 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:11.349165 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:11.349749 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:11.366459 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d HTTP/1.1 Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:11.368327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:11.369793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '377d03c5-57ad-4120-93c6-10a03315249d'} Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:11.370562 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:11.371840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:11.372960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:11.372960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9b31fb79-2226-4932-9c71-b65808fd3a05 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 404 len: 111 microversion: 2.1 time: 0.036529 Aug 26 12:21:11.378799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93734f64-b823-4c10-8bb1-4ac2447731ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '.version_select at 0x7ffa975d85e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:11.384509 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 387/774] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:11 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:11.401841 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93734f64-b823-4c10-8bb1-4ac2447731ed tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644567266" status: 202 len: 0 microversion: 2.1 time: 0.026836 Aug 26 12:21:11.402472 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 388/775] 10.222.0.61 () {58 vars in 1218 bytes} [Fri Aug 26 12:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644567266 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:21:11.796278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:11.796905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:11.810403 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:11.811443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:11.811925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:11.812834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:11.814729 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:11.815329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:12.016866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:12.027399 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:12.029166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:12.031437 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-26bd72cc-24f8-4e2b-8128-7409a4268576 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.239159 Aug 26 12:21:12.032572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 388/776] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:11 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:13.057653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:13.058850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:13.068297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:13.068824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:13.078843 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:13.080059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:13.082277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:13.084021 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:13.225285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:13.240040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:13.241738 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:13.243089 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16ba8288-0ed5-44db-b29b-b8c85f055f46 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.191092 Aug 26 12:21:13.243656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 389/777] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:13 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:13.368264 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:13.369396 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:13.377115 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:13.377851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:13.378448 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:13.379335 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:13.379779 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:13.380369 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:13.395242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d HTTP/1.1 Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:13.397418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.399028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '377d03c5-57ad-4120-93c6-10a03315249d'} Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:13.399937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.401713 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.404905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:13.406101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6e5c4e84-d89e-4305-9d4b-1574a8eefcd7 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 404 len: 111 microversion: 2.1 time: 0.042544 Aug 26 12:21:13.407246 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 389/778] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:21:13 2022] DELETE /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:13.417724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:13.418619 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 377d03c5-57ad-4120-93c6-10a03315249d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:13.425093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:13.425579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:13.425998 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:13.426698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:13.427144 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:13.427802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:13.445911 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d HTTP/1.1 Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:21:13.448067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.449449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '377d03c5-57ad-4120-93c6-10a03315249d'} Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:13.453909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. Aug 26 12:21:13.455881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:13.459775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 377d03c5-57ad-4120-93c6-10a03315249d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:13.459775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7da8f819-f806-41fe-bbfb-859a7a5d84be tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d" status: 404 len: 111 microversion: 2.1 time: 0.038413 Aug 26 12:21:13.459775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 390/779] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:13 2022] GET /compute/v2.1/servers/377d03c5-57ad-4120-93c6-10a03315249d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 12:21:14.271593 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:14.272215 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:14.278883 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.280738 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.281297 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.282118 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.282739 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.283511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.438462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:14.454426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:14.456053 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:14.457333 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b0aa4c57-ac8a-4e79-867c-e19caa03e84e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.191131 Aug 26 12:21:14.458009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 390/780] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:14 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:14.658445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:14.658961 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:14.674922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.675448 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.676077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.677072 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.677786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.678453 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.695946 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de HTTP/1.1 Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:21:14.697809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.699416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '44c064ae-bbc4-419e-adb2-2ad34d8a75de'} Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:14.700338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.703026 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.706011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:14.707993 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a493f02-94a8-40f8-b7c2-82545623971a tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 404 len: 111 microversion: 2.1 time: 0.053210 Aug 26 12:21:14.709045 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 391/781] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:21:14 2022] DELETE /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:14.718634 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:14.719576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 44c064ae-bbc4-419e-adb2-2ad34d8a75de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:14.726826 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.727701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.728298 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.729490 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.730106 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.730796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.750894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de HTTP/1.1 Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:14.752681 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.754398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '44c064ae-bbc4-419e-adb2-2ad34d8a75de'} Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:14.755330 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. Aug 26 12:21:14.756794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.759753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 44c064ae-bbc4-419e-adb2-2ad34d8a75de could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:14.760887 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1a607644-d6e7-4b0e-82d0-d271ffd5db5e tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de" status: 404 len: 111 microversion: 2.1 time: 0.047839 Aug 26 12:21:14.761627 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 391/782] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:14 2022] GET /compute/v2.1/servers/44c064ae-bbc4-419e-adb2-2ad34d8a75de => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:14.770614 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:14.772017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:14.780687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.781503 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.782817 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.784059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.784707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.785449 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.803043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c HTTP/1.1 Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:21:14.804992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.806357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'e6927fcc-8685-4602-9ac7-c09fcde9d05c'} Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:14.807093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.808890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.811756 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:14.811756 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ea32209-a2bf-40c5-bd53-1ac90f0189c8 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 404 len: 111 microversion: 2.1 time: 0.040439 Aug 26 12:21:14.811756 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 392/783] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:21:14 2022] DELETE /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:14.815889 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:14.816701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: e6927fcc-8685-4602-9ac7-c09fcde9d05c] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:14.825140 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.826173 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.827008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.828143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:14.828620 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:14.829054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:14.847376 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c HTTP/1.1 Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:14.848999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.850353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': 'e6927fcc-8685-4602-9ac7-c09fcde9d05c'} Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:14.851236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. Aug 26 12:21:14.852635 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:14.853802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance e6927fcc-8685-4602-9ac7-c09fcde9d05c could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:14.853802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bd946626-285d-4831-83aa-e5b371a49dc9 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c" status: 404 len: 111 microversion: 2.1 time: 0.038552 Aug 26 12:21:14.853802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 392/784] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:14 2022] GET /compute/v2.1/servers/e6927fcc-8685-4602-9ac7-c09fcde9d05c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 26 12:21:15.483926 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:15.485005 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:15.492221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:15.492970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:15.493403 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:15.494373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:15.495099 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:15.495758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:15.895137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:15.905580 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:15.908513 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:15.909908 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2acec500-0e25-4fe5-825f-136f79f77a9b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1740 microversion: 2.20 time: 0.432623 Aug 26 12:21:15.910450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 393/785] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:15 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:16.040923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:16.043071 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:16.051486 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:16.051966 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:16.052910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:16.053897 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:16.054349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:16.054920 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:16.071402 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec HTTP/1.1 Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:16.072705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.074164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '92140aaa-db0d-49e1-9c47-c71a24aeeeec'} Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:16.074913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.076727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.078188 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:16.078188 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2b88959c-6f4b-4688-926f-470fdbd044d1 tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "DELETE /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 404 len: 111 microversion: 2.1 time: 0.037895 Aug 26 12:21:16.078188 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 393/786] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:21:16 2022] DELETE /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:16.083933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:16.084539 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] [instance: 92140aaa-db0d-49e1-9c47-c71a24aeeeec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:16.090400 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:16.090877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:16.091330 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:16.092633 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:16.093082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:16.093494 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:16.109373 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] HTTP exception thrown: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Request method failure captured: Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec HTTP/1.1 Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLkbys5VS8Y4QwgRS7Arm6qMFjvC07pii3w0ixTd4bjCSd6ul9HroobTt4S6SD9CmLMk5KqbonRYCxcVaCsvBJ6U42PorVjiLjc1geFZbgSqMWbjf3nwMqQXH7LfPfPCoqJpN0ICNva8v0W134fSd1nCQ9sG8bE3sMy6WV2M4JGMH9M Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:21:16.110984 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9574496fe7ba4144a05fca690cc3486f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9574496fe7ba4144a05fca690cc3486f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9574496fe7ba4144a05fca690cc3486f Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-343212200 Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 36a27ca98a2e4521b269be48c9ec4cb0 Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-343212200-project Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.112701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '92140aaa-db0d-49e1-9c47-c71a24aeeeec'} Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:16.113934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. Aug 26 12:21:16.115588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:16.117173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] Returning 404 to user: Instance 92140aaa-db0d-49e1-9c47-c71a24aeeeec could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:16.117173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-920edb04-bf9e-45b4-b3cb-5dc4fe57101d tempest-AttachVolumeNegativeTest-343212200 tempest-AttachVolumeNegativeTest-343212200-project] 10.222.0.61 "GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec" status: 404 len: 111 microversion: 2.1 time: 0.032614 Aug 26 12:21:16.117173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 394/787] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:21:16 2022] GET /compute/v2.1/servers/92140aaa-db0d-49e1-9c47-c71a24aeeeec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:16.933673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:16.934743 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:16.941906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:16.942398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:16.942834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:16.943576 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:16.944025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:16.944651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:17.162978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:17.171929 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:17.173479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:17.174721 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bf6931e2-38ee-4c6f-a4ba-bea7f3c86580 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1722 microversion: 2.20 time: 0.245099 Aug 26 12:21:17.188468 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 394/788] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:16 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:18.198171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:18.198837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:18.205628 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:18.206241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:18.206774 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:18.207598 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:18.208165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:18.208808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:18.655438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:18.664554 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:18.666418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:18.667859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e60cb08b-4690-4f39-aee3-9f6d19aaed1e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1722 microversion: 2.20 time: 0.473761 Aug 26 12:21:18.668931 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 395/789] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:18 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1722 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:19.433104 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8cb512d4-0ae3-4b22-939e-f8a4fccacab4 req-05eb5b77-1585-4143-97db-0e9fc77eb43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79b22dd-76aa-4cd2-814b-5d61b81a73bd", "name": "network-vif-unplugged", "status": "completed", "tag": "6d70c9aa-09a0-4252-9c28-50bff97caa6f"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:19.452563 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8cb512d4-0ae3-4b22-939e-f8a4fccacab4 req-05eb5b77-1585-4143-97db-0e9fc77eb43c service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:19.453050 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8cb512d4-0ae3-4b22-939e-f8a4fccacab4 req-05eb5b77-1585-4143-97db-0e9fc77eb43c service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:19.456887 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8cb512d4-0ae3-4b22-939e-f8a4fccacab4 req-05eb5b77-1585-4143-97db-0e9fc77eb43c service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:19.484251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8cb512d4-0ae3-4b22-939e-f8a4fccacab4 req-05eb5b77-1585-4143-97db-0e9fc77eb43c service nova] Creating event network-vif-unplugged:6d70c9aa-09a0-4252-9c28-50bff97caa6f for instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd on hv-cinder-84630 Aug 26 12:21:19.497251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8cb512d4-0ae3-4b22-939e-f8a4fccacab4 req-05eb5b77-1585-4143-97db-0e9fc77eb43c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068026 Aug 26 12:21:19.497983 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 395/790] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:19.696882 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:19.698274 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:19.706377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:19.707171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:19.708263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:19.709367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:19.710231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:19.711265 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:19.940469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:19.949315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:19.951728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:19.953197 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ae33c8e-76c9-48d2-986b-d99fd959925b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1665 microversion: 2.20 time: 0.260162 Aug 26 12:21:19.954276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 396/791] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:19 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1665 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:19.977453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edb0b4e1-dbd2-4871-b34f-f99a73964d08"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:19.980018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:19.987150 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:19.987975 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:19.988820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:19.989698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:19.990316 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:19.990906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:20.308800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-79c7cbb9-1090-4266-a38f-fe9a61e3ec7b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336154 Aug 26 12:21:20.315570 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 396/792] 10.222.0.61 () {62 vars in 1364 bytes} [Fri Aug 26 12:21:19 2022] POST /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:21:20.459787 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:20.460382 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:20.466487 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:20.467782 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:20.468161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:20.468856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:20.469310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:20.469732 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:20.515133 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 12:21:20.592762 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35294423-6734-447a-bfdd-2111f19b9ea0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/action" status: 202 len: 0 microversion: 2.20 time: 0.136928 Aug 26 12:21:20.594030 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 397/793] 10.222.0.61 () {62 vars in 1319 bytes} [Fri Aug 26 12:21:20 2022] POST /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:21:20.602547 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:20.603764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:20.611915 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:20.612617 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:20.613497 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:20.614953 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:20.615488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:20.616698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:20.780746 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:20.788974 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:20.792998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:20.795229 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:20.796546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0eeaf987-e272-404c-8840-b4df6ce860cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1751 microversion: 2.20 time: 0.198554 Aug 26 12:21:20.797111 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 397/794] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:20 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:21.820581 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:21.821532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:21.830230 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:21.830782 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:21.831318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:21.832129 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:21.833253 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:21.833568 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:21.864318 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce72836b-3f58-4d8f-aa7d-f07c1de99b12 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Action: 'create', calling method: .version_select at 0x7ffa97573790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1103683068"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:22.025368 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:22.039347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:22.041991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:22.043849 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-903c2a1b-6b90-411f-a67a-b1e1f37b44d8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1751 microversion: 2.20 time: 0.227244 Aug 26 12:21:22.045481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 398/795] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:21 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:22.258897 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce72836b-3f58-4d8f-aa7d-f07c1de99b12 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.552448 Aug 26 12:21:22.259775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 398/796] 10.222.0.61 () {60 vars in 1155 bytes} [Fri Aug 26 12:21:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 554 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 12:21:22.275045 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ab429fd9-31ae-403d-abf9-a0bf93cf8e23 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa9771d3a0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:22.336931 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ab429fd9-31ae-403d-abf9-a0bf93cf8e23 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c" status: 200 len: 345 microversion: 2.1 time: 0.067233 Aug 26 12:21:22.338014 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 399/797] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:22 2022] GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:23.067784 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:23.069018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:23.077043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:23.078043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:23.078864 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:23.079641 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:23.080269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:23.080690 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:23.224788 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:23.234364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:23.235920 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:23.237085 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcbc924c-d0bc-49d3-8a1a-068457467e2b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.173547 Aug 26 12:21:23.237627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 399/798] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:23 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:23.351666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-722b12b1-db63-4e39-89fa-f1485c46d1ed tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa97743700>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:23.399344 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-722b12b1-db63-4e39-89fa-f1485c46d1ed tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c" status: 200 len: 346 microversion: 2.1 time: 0.051854 Aug 26 12:21:23.399941 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 400/799] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:23 2022] GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:23.412792 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7584f02f-e20a-40e1-9010-0a32729eb1da tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Action: 'create', calling method: .version_select at 0x7ffa975734c0>, body: {"snapshot": {"volume_id": "4220d8f7-90f8-4161-85d3-6f2eed36c13c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1674153830"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:23.580135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7584f02f-e20a-40e1-9010-0a32729eb1da tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.170971 Aug 26 12:21:23.581288 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 400/800] 10.222.0.61 () {60 vars in 1162 bytes} [Fri Aug 26 12:21:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:23.597940 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd8a26f1-181d-4370-bd54-cfcb50a64dea tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa97743dc0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:23.640164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dd8a26f1-181d-4370-bd54-cfcb50a64dea tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 200 len: 287 microversion: 2.1 time: 0.051130 Aug 26 12:21:23.640993 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 401/801] 10.222.0.61 () {58 vars in 1251 bytes} [Fri Aug 26 12:21:23 2022] GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:21:23.652530 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63f64cc2-04d5-4970-972b-ee894bce17e7 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa97609af0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:23.689238 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63f64cc2-04d5-4970-972b-ee894bce17e7 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039820 Aug 26 12:21:23.689811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 401/802] 10.222.0.61 () {58 vars in 1140 bytes} [Fri Aug 26 12:21:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:23.701780 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3b70a797-81b6-4175-8cb4-fbc09d23c48c tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa97743b80>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:23.750009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3b70a797-81b6-4175-8cb4-fbc09d23c48c tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 200 len: 287 microversion: 2.1 time: 0.052764 Aug 26 12:21:23.750459 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 402/803] 10.222.0.61 () {58 vars in 1251 bytes} [Fri Aug 26 12:21:23 2022] GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:24.261739 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:24.262385 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:24.270228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:24.270742 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:24.271193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:24.271916 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:24.272367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:24.272788 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:24.408457 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:24.416967 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:24.418414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:24.419615 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e699c26f-102e-4808-bcff-5e0d472e3eea tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.163039 Aug 26 12:21:24.420167 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 402/804] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:24 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:24.762405 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9ad1a9f7-07f3-4fcc-acf7-414d2609e128 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa976d0dc0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:24.791571 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9ad1a9f7-07f3-4fcc-acf7-414d2609e128 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 200 len: 287 microversion: 2.1 time: 0.033505 Aug 26 12:21:24.792263 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 403/805] 10.222.0.61 () {58 vars in 1251 bytes} [Fri Aug 26 12:21:24 2022] GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:25.445471 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:25.446052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:25.453348 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:25.453846 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:25.454290 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:25.454961 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:25.455435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:25.455846 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:25.586828 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:25.595510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:25.596950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:25.598094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19aabb2c-b4f0-4973-8add-6eab88a1241b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.156552 Aug 26 12:21:25.598664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 403/806] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:25 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:25.805181 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b56066a8-e40d-4f75-ada5-fc32702fcda3 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa97758af0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:25.837788 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b56066a8-e40d-4f75-ada5-fc32702fcda3 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 200 len: 287 microversion: 2.1 time: 0.036801 Aug 26 12:21:25.838375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 404/807] 10.222.0.61 () {58 vars in 1251 bytes} [Fri Aug 26 12:21:25 2022] GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:26.620642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:26.621952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:26.628728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:26.629194 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:26.629635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:26.630374 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:26.630769 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:26.631408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:26.779969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:26.789486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:26.790953 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:26.792137 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8ea08a1-ccf6-4549-94ab-8c16496b13a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.175512 Aug 26 12:21:26.792696 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 404/808] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:26 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:26.849777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9e85483a-c236-4691-8e87-d19bc094e5d0 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa97743820>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:26.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9e85483a-c236-4691-8e87-d19bc094e5d0 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 200 len: 288 microversion: 2.1 time: 0.035072 Aug 26 12:21:26.881758 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 405/809] 10.222.0.61 () {58 vars in 1251 bytes} [Fri Aug 26 12:21:26 2022] GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:26.893105 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5da5b72-8c4d-4b2a-a816-778b40b886fe tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa975d6b80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:26.963127 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5da5b72-8c4d-4b2a-a816-778b40b886fe tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 202 len: 0 microversion: 2.1 time: 0.074171 Aug 26 12:21:26.967160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 405/810] 10.222.0.61 () {58 vars in 1254 bytes} [Fri Aug 26 12:21:26 2022] DELETE /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:21:26.973618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-40e276c7-05bc-477e-b6ad-bf16e7c6a88c tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa9771dd30>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:27.010905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-40e276c7-05bc-477e-b6ad-bf16e7c6a88c tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 200 len: 287 microversion: 2.1 time: 0.041866 Aug 26 12:21:27.011645 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 406/811] 10.222.0.61 () {58 vars in 1251 bytes} [Fri Aug 26 12:21:26 2022] GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:27.815604 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:27.816222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:27.822315 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:27.823016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:27.823478 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:27.824175 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:27.824629 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:27.825049 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:27.962408 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:27.972365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:27.973796 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:27.975078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-166c64ce-5c7f-463b-8d7f-b7b4f57716e5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.164027 Aug 26 12:21:27.975618 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 406/812] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:27 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:28.025028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89ce3b58-cc61-4d14-b1ab-8a6905372965 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa977dba60>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:28.062494 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-89ce3b58-cc61-4d14-b1ab-8a6905372965 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] HTTP exception thrown: Snapshot 3a84adab-837f-4782-83ac-05da14a1e228 could not be found. Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89ce3b58-cc61-4d14-b1ab-8a6905372965 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Request method failure captured: Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 HTTP/1.1 Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLrBlkUw27fr9FjAZzwl2mBMHGG-R45ZQ8ljqCyfsPJlP_dKprShazN-e6AkTs26bwKiL3v3xMCCghXe4Ox_b8ED_f1RWLFEw5ywbzKmmL59OVHRhpvzrP2vO3LUA5PomecwRlZWeoUxYNV-YD86g1G1zECX-SaasuLQhOmagb9sqig Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:28.065877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ff2ea99f18f449a87c6b4625110527f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 3893122ee89f4bb3af4d7dbd478b22d8 Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Snapshot 3a84adab-837f-4782-83ac-05da14a1e228 could not be found. Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '3a84adab-837f-4782-83ac-05da14a1e228'} Aug 26 12:21:28.067837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3a84adab-837f-4782-83ac-05da14a1e228 could not be found. (HTTP 404) (Request-ID: req-780a2fad-fa7d-4b37-95f9-ae70e7c3e2a7) Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:28.068998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:28.070895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3a84adab-837f-4782-83ac-05da14a1e228 could not be found. Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 26 12:21:28.072262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3a84adab-837f-4782-83ac-05da14a1e228 could not be found. Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3a84adab-837f-4782-83ac-05da14a1e228 could not be found. Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89ce3b58-cc61-4d14-b1ab-8a6905372965 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Returning 404 to user: Snapshot 3a84adab-837f-4782-83ac-05da14a1e228 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:28.073751 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-89ce3b58-cc61-4d14-b1ab-8a6905372965 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228" status: 404 len: 111 microversion: 2.1 time: 0.046783 Aug 26 12:21:28.076231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af2579ac-4a1d-4e9f-b935-c75928708d3a tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa976d3e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:28.076624 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 407/813] 10.222.0.61 () {58 vars in 1251 bytes} [Fri Aug 26 12:21:28 2022] GET /compute/v2.1/os-snapshots/3a84adab-837f-4782-83ac-05da14a1e228 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:28.140878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af2579ac-4a1d-4e9f-b935-c75928708d3a tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c" status: 202 len: 0 microversion: 2.1 time: 0.068317 Aug 26 12:21:28.143529 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 407/814] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:21:28 2022] DELETE /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:21:28.150227 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7c37c95e-3ed4-4024-99d2-06acddda3a04 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa97743670>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:28.204322 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7c37c95e-3ed4-4024-99d2-06acddda3a04 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c" status: 200 len: 345 microversion: 2.1 time: 0.058099 Aug 26 12:21:28.205825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 408/815] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:28 2022] GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:29.001181 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:29.001848 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:29.008118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:29.008856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:29.009285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:29.009985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:29.010435 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:29.010851 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:29.153572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:29.163310 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:29.164757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:29.165924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd2e0825-5f2c-40fc-85b1-16781434b083 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.169802 Aug 26 12:21:29.166880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 408/816] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:28 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:29.218823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b4c485eb-b737-4242-b63c-8ebb140406b6 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa9772b940>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:29.251320 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-b4c485eb-b737-4242-b63c-8ebb140406b6 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] HTTP exception thrown: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b4c485eb-b737-4242-b63c-8ebb140406b6 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Request method failure captured: Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c HTTP/1.1 Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLrBlkUw27fr9FjAZzwl2mBMHGG-R45ZQ8ljqCyfsPJlP_dKprShazN-e6AkTs26bwKiL3v3xMCCghXe4Ox_b8ED_f1RWLFEw5ywbzKmmL59OVHRhpvzrP2vO3LUA5PomecwRlZWeoUxYNV-YD86g1G1zECX-SaasuLQhOmagb9sqig Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:29.254536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ff2ea99f18f449a87c6b4625110527f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 3893122ee89f4bb3af4d7dbd478b22d8 Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '4220d8f7-90f8-4161-85d3-6f2eed36c13c'} Aug 26 12:21:29.256356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. (HTTP 404) (Request-ID: req-242e424e-82d1-40f4-a8b1-7be5b7421541) Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.257408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:29.258829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 12:21:29.260938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b4c485eb-b737-4242-b63c-8ebb140406b6 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Returning 404 to user: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:29.263019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b4c485eb-b737-4242-b63c-8ebb140406b6 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c" status: 404 len: 109 microversion: 2.1 time: 0.043340 Aug 26 12:21:29.265024 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 409/817] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:29 2022] GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:29.277302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-921918ab-231f-49d0-862b-9a7ab7b675bd tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa975d6160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:29.307161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-921918ab-231f-49d0-862b-9a7ab7b675bd tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] HTTP exception thrown: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-921918ab-231f-49d0-862b-9a7ab7b675bd tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Request method failure captured: Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c HTTP/1.1 Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLrBlkUw27fr9FjAZzwl2mBMHGG-R45ZQ8ljqCyfsPJlP_dKprShazN-e6AkTs26bwKiL3v3xMCCghXe4Ox_b8ED_f1RWLFEw5ywbzKmmL59OVHRhpvzrP2vO3LUA5PomecwRlZWeoUxYNV-YD86g1G1zECX-SaasuLQhOmagb9sqig Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:21:29.309273 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ff2ea99f18f449a87c6b4625110527f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 3893122ee89f4bb3af4d7dbd478b22d8 Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '4220d8f7-90f8-4161-85d3-6f2eed36c13c'} Aug 26 12:21:29.310833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. (HTTP 404) (Request-ID: req-6558b604-1cc5-4872-81de-19979411efd0) Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.312136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 26 12:21:29.313807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 26 12:21:29.315241 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-921918ab-231f-49d0-862b-9a7ab7b675bd tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Returning 404 to user: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-921918ab-231f-49d0-862b-9a7ab7b675bd tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c" status: 404 len: 109 microversion: 2.1 time: 0.037293 Aug 26 12:21:29.316645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 409/818] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:21:29 2022] DELETE /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:29.319171 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f8a2bfd9-49af-4966-9571-b72660866d30 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Calling method '.version_select at 0x7ffa977cba60>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:29.348276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f8a2bfd9-49af-4966-9571-b72660866d30 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] HTTP exception thrown: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f8a2bfd9-49af-4966-9571-b72660866d30 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Request method failure captured: Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c HTTP/1.1 Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLrBlkUw27fr9FjAZzwl2mBMHGG-R45ZQ8ljqCyfsPJlP_dKprShazN-e6AkTs26bwKiL3v3xMCCghXe4Ox_b8ED_f1RWLFEw5ywbzKmmL59OVHRhpvzrP2vO3LUA5PomecwRlZWeoUxYNV-YD86g1G1zECX-SaasuLQhOmagb9sqig Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:29.350847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ff2ea99f18f449a87c6b4625110527f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ff2ea99f18f449a87c6b4625110527f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 5ff2ea99f18f449a87c6b4625110527f Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133690784 Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 3893122ee89f4bb3af4d7dbd478b22d8 Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133690784-project Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '4220d8f7-90f8-4161-85d3-6f2eed36c13c'} Aug 26 12:21:29.352893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. (HTTP 404) (Request-ID: req-e73820d6-408e-4ff2-94ed-7a2bc539df2f) Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.353987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:29.356208 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 12:21:29.357967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f8a2bfd9-49af-4966-9571-b72660866d30 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] Returning 404 to user: Volume 4220d8f7-90f8-4161-85d3-6f2eed36c13c could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f8a2bfd9-49af-4966-9571-b72660866d30 tempest-VolumesSnapshotsTestJSON-2133690784 tempest-VolumesSnapshotsTestJSON-2133690784-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c" status: 404 len: 109 microversion: 2.1 time: 0.036835 Aug 26 12:21:29.361119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 410/819] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:29 2022] GET /compute/v2.1/os-volumes/4220d8f7-90f8-4161-85d3-6f2eed36c13c => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:30.194822 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:30.195340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:30.204263 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:30.204757 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:30.205186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:30.206103 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:30.211912 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:30.212868 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:30.418716 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:30.440258 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:30.441712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:30.443056 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88a4a843-0006-45d5-a0fd-8ce8c3ea8d93 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.257008 Aug 26 12:21:30.447244 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 410/820] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:30 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:31.369973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-499d3e2c-e373-4166-9981-d734a937c5af tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Action: 'create', calling method: .version_select at 0x7ffa9768ca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1284291989", "metadata": {"Type": "work"}}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:31.468451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:31.469949 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:31.483834 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:31.484579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:31.485205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:31.486087 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:31.486695 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:31.487295 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:31.492395 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:31.677122 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:31.690735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:31.692564 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:31.693981 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13459ce0-6da0-405d-beaf-bf13212b3c86 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.229842 Aug 26 12:21:31.721943 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 411/821] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:31 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:31.782145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-499d3e2c-e373-4166-9981-d734a937c5af tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.559210 Aug 26 12:21:31.782908 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 411/822] 10.222.0.61 () {60 vars in 1156 bytes} [Fri Aug 26 12:21:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 561 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 26 12:21:31.795118 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a673406a-602b-4998-b312-ed9c46d43c5c tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Calling method '.version_select at 0x7ffa97649ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:31.869337 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a673406a-602b-4998-b312-ed9c46d43c5c tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5" status: 200 len: 353 microversion: 2.1 time: 0.077998 Aug 26 12:21:31.870413 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 412/823] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:31 2022] GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:21:32.721404 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:32.724338 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:32.726868 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=23 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:32.727897 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=7 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:32.735904 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:32.736947 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:32.737401 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:32.738383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:32.738840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:32.739804 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:32.885496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4df85ef1-5229-4f81-a1d5-789ccaae30d2 tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Calling method '.version_select at 0x7ffa975d8430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:32.903261 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:32.915601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:32.918032 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:32.919238 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-460b2ec9-7673-4510-b1b8-86c0ab9d40c0 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.203862 Aug 26 12:21:32.919781 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 412/824] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:32 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:32.950309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4df85ef1-5229-4f81-a1d5-789ccaae30d2 tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5" status: 200 len: 354 microversion: 2.1 time: 0.070020 Aug 26 12:21:32.951138 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 413/825] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:32 2022] GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:32.969067 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-06017e3c-a69e-4ad4-a27f-a9c15c6d111b tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Calling method '.version_select at 0x7ffa977b5310>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:33.049030 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-06017e3c-a69e-4ad4-a27f-a9c15c6d111b tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5" status: 200 len: 354 microversion: 2.1 time: 0.084368 Aug 26 12:21:33.049866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 413/826] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:32 2022] GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:33.071302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e0fdd7c-8a1f-469b-a4d7-9e264c00c4df tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Calling method '.version_select at 0x7ffa97585790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:33.190356 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e0fdd7c-8a1f-469b-a4d7-9e264c00c4df tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5" status: 202 len: 0 microversion: 2.1 time: 0.124498 Aug 26 12:21:33.192161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 414/827] 10.222.0.61 () {58 vars in 1248 bytes} [Fri Aug 26 12:21:33 2022] DELETE /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:21:33.200615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6742802f-7334-4963-a47f-156dc6fafbf2 tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Calling method '.version_select at 0x7ffa97699b80>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:33.261696 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6742802f-7334-4963-a47f-156dc6fafbf2 tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5" status: 200 len: 353 microversion: 2.1 time: 0.065185 Aug 26 12:21:33.262874 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 414/828] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:33 2022] GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:33.945042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:33.945042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:33.970510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:21:33.972304 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:33.972797 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:33.973228 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:33.973943 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:33.974400 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:33.974825 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:34.148669 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:34.164926 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:34.166534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:34.170326 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-acc17edd-75ca-4942-964f-142f93d6a57e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.231250 Aug 26 12:21:34.172080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 415/829] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:33 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:34.290508 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d0d14332-663d-4a38-8fa2-4238e411ed8b tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Calling method '.version_select at 0x7ffa9769e790>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:34.321992 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-d0d14332-663d-4a38-8fa2-4238e411ed8b tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] HTTP exception thrown: Volume 6342712e-d6a0-4c7d-8c24-0033d5c09ce5 could not be found. Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d0d14332-663d-4a38-8fa2-4238e411ed8b tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Request method failure captured: Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5 HTTP/1.1 Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLrLIADhMwhClRpm4YE4B3nAj9tV8K-K1pHl-4L8dlqsR8MOEOZJ9GkF3KzyyTQvwB7vSxzrJFOuyaJzISDRZMgayT2J-Co92cMTtXpzV-XgTPtG2SvQ1ExolK18t4B1ymm8_ceaIzvnMq-arUH70lUybc6PS6UJVY1S65hThGbJrjA Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: a895db96a8a14bb1b5e058700f5d3915 Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesGetTestJSON-1781873103 Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:21:34.324162 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a895db96a8a14bb1b5e058700f5d3915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a895db96a8a14bb1b5e058700f5d3915", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a895db96a8a14bb1b5e058700f5d3915"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a895db96a8a14bb1b5e058700f5d3915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesGetTestJSON-1781873103 Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: a895db96a8a14bb1b5e058700f5d3915 Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesGetTestJSON-1781873103 Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesGetTestJSON-1781873103-project Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 03624d67fc254b0c98fa42e28969d8f1 Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesGetTestJSON-1781873103-project Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Volume 6342712e-d6a0-4c7d-8c24-0033d5c09ce5 could not be found. Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '6342712e-d6a0-4c7d-8c24-0033d5c09ce5'} Aug 26 12:21:34.325895 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6342712e-d6a0-4c7d-8c24-0033d5c09ce5 could not be found. (HTTP 404) (Request-ID: req-cae18244-2431-43c8-8718-c37c26d5531d) Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:34.327556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 26 12:21:34.329533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6342712e-d6a0-4c7d-8c24-0033d5c09ce5 could not be found. Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 26 12:21:34.331505 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6342712e-d6a0-4c7d-8c24-0033d5c09ce5 could not be found. Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6342712e-d6a0-4c7d-8c24-0033d5c09ce5 could not be found. Aug 26 12:21:34.333595 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:21:34.337387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d0d14332-663d-4a38-8fa2-4238e411ed8b tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] Returning 404 to user: Volume 6342712e-d6a0-4c7d-8c24-0033d5c09ce5 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:21:34.337387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d0d14332-663d-4a38-8fa2-4238e411ed8b tempest-VolumesGetTestJSON-1781873103 tempest-VolumesGetTestJSON-1781873103-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5" status: 404 len: 109 microversion: 2.1 time: 0.049423 Aug 26 12:21:34.337938 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 415/830] 10.222.0.61 () {58 vars in 1245 bytes} [Fri Aug 26 12:21:34 2022] GET /compute/v2.1/os-volumes/6342712e-d6a0-4c7d-8c24-0033d5c09ce5 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:21:35.194750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:35.196041 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:35.202325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:35.202900 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:35.203573 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:35.204574 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:35.205193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:35.205613 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:35.353891 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:35.365702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:35.367412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:35.368952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ee9c9c2-e196-4cd7-8d48-2be27c29e221 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.178117 Aug 26 12:21:35.369758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 416/831] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:35 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:36.393291 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:36.393777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:36.399661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:36.400148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:36.400579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:36.401269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:36.401719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:36.402138 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:36.537540 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:36.546799 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:36.550584 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:36.550584 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-28c5d77a-5326-497a-917a-81a54d36d96c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.161194 Aug 26 12:21:36.550584 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 416/832] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:36 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:37.574741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:37.575606 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:37.582579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:37.583169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:37.583708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:37.584483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:37.585040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:37.585548 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:37.728221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:37.737410 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:37.739424 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:37.740805 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe2c91e2-4538-43d3-b64b-a2d6429d8e84 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.170537 Aug 26 12:21:37.741355 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 417/833] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:37 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:38.764004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:38.765052 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:38.771426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:38.771973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:38.772477 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:38.773231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:38.773759 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:38.774246 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:38.907041 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:38.915638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:38.917083 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:38.918232 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fa5051cb-aea1-4424-a331-419afb307d4b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.158192 Aug 26 12:21:38.918814 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 417/834] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:38 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:39.942989 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:39.943635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:39.950042 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:39.950519 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:39.950950 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:39.952322 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:39.952938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:39.953366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:40.078826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:40.087370 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:40.088813 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:40.089971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5bbe384f-cf5c-4dee-9e7c-b56e176bb508 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.150848 Aug 26 12:21:40.090527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 418/835] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:39 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:41.112159 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:41.113328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:41.119652 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:41.120129 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:41.120559 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:41.121244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:41.121685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:41.122105 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:41.268949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:41.277815 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:41.279397 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:41.281197 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dbe5e36f-c083-41f5-aca4-8daf9d3b44c9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.172885 Aug 26 12:21:41.281842 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 418/836] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:41 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:42.303458 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:42.304143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:42.310454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:42.311143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:42.311492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:42.312179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:42.312622 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:42.313035 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:42.448525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:42.457659 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:42.459090 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:42.460249 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2fa88085-55f2-4815-8085-1e7e8e04ec35 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.160759 Aug 26 12:21:42.460817 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 419/837] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:42 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:43.484500 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:43.485108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:43.491727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:43.492213 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:43.492643 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:43.493334 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:43.493784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:43.494202 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:43.630116 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:43.638509 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:43.640164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:43.641302 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-11118956-af21-4413-8b6a-914d23f8cf04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.161283 Aug 26 12:21:43.641869 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 419/838] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:43 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:44.664349 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:44.664948 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:44.671525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:44.672001 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:44.672632 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:44.673317 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:44.673759 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:44.674175 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:44.812735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:44.821245 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:44.822675 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:44.823842 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09d7eb49-a6be-421b-b4fc-dea9c3240982 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.163606 Aug 26 12:21:44.824389 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 420/839] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:44 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:45.847052 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:45.847707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:45.854387 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:45.854878 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:45.855346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:45.856052 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:45.856592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:45.856921 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:46.036329 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:46.044839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:46.046285 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:46.047452 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cb7bdd0c-024c-472d-bf9a-d6303333357e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.205043 Aug 26 12:21:46.047997 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 420/840] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:45 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:47.070560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:47.071386 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:47.078198 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:47.078699 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:47.079684 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:47.080621 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:47.081298 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:47.081726 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:47.221541 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:47.230746 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:47.232429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:47.233805 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e150c088-5265-4220-82c6-8752fbc8e654 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.167381 Aug 26 12:21:47.234956 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 421/841] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:47 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:47.896823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-cf006b9c-8a02-419e-ab02-86ef063ae458 req-e04e2b46-94db-443c-8433-9de42b275add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79b22dd-76aa-4cd2-814b-5d61b81a73bd", "name": "network-vif-plugged", "status": "completed", "tag": "6d70c9aa-09a0-4252-9c28-50bff97caa6f"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:21:47.906960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-cf006b9c-8a02-419e-ab02-86ef063ae458 req-e04e2b46-94db-443c-8433-9de42b275add service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:47.907476 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-cf006b9c-8a02-419e-ab02-86ef063ae458 req-e04e2b46-94db-443c-8433-9de42b275add service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:47.907906 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-cf006b9c-8a02-419e-ab02-86ef063ae458 req-e04e2b46-94db-443c-8433-9de42b275add service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:47.918745 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-cf006b9c-8a02-419e-ab02-86ef063ae458 req-e04e2b46-94db-443c-8433-9de42b275add service nova] Creating event network-vif-plugged:6d70c9aa-09a0-4252-9c28-50bff97caa6f for instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd on hv-cinder-84630 Aug 26 12:21:47.923762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-cf006b9c-8a02-419e-ab02-86ef063ae458 req-e04e2b46-94db-443c-8433-9de42b275add service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030558 Aug 26 12:21:47.924306 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 421/842] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:21:48.257830 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:48.258517 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:48.265416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:48.265897 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:48.266329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:48.267070 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:48.267532 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:48.267951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:48.412973 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:48.423974 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:48.425489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:48.426667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-551cbd05-4a05-4e29-88bd-4e7c1d40c700 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.173004 Aug 26 12:21:48.427252 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 422/843] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:48 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:49.456836 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:49.457667 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:49.464710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:49.465320 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:49.465794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:49.466569 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:49.467148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:49.467719 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:49.598078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:49.606993 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:49.608478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:49.609620 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8ede64e1-13ab-4eef-8d74-f833f65a1a5c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.162169 Aug 26 12:21:49.610170 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 422/844] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:49 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:21:50.632861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:50.633466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:50.640329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:50.640811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:50.641243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:50.641941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:50.642388 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:50.642809 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:50.780567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:50.789392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:50.790840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:50.792028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c78320f-3943-44d7-b979-749404fc9e45 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.163011 Aug 26 12:21:50.792573 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 423/845] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:50 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:51.815641 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:51.816176 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:51.822786 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:51.823537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:51.823977 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:51.824673 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:51.825125 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:51.825552 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:52.067802 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:52.077688 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:52.080282 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:52.081701 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cc002a83-aa8b-41ab-9262-27b1efb381ed tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1809 microversion: 2.20 time: 0.270892 Aug 26 12:21:52.082734 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 423/846] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:51 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:21:53.110276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:21:53.110905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:21:53.124264 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:53.124802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:53.125899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:53.126912 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:21:53.127409 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:21:53.127840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:21:53.385339 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:53.395268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:53.396732 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:21:53.404106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39e8c5c4-0345-4786-8ee8-c79770b929df tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1796 microversion: 2.20 time: 0.297914 Aug 26 12:21:53.405328 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 424/847] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:21:53 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1796 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:00.360418 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b89698d6-7532-47ad-9581-ad364d7be947 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Action: 'create', calling method: .version_select at 0x7ffa9768c310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1601804971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiiC/UkwRD/hEUYucNFa4DnqpHKYzMnmK3uccy/GFrTU1nXY1+xhhW1e/HLYQ98WhOdzn2+RwjFbDc/JXnmBmM/00KfIkzagHX7chXfmnuDUx5/Oyy+m/ysMPbf1nIGzw=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:00.376927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b89698d6-7532-47ad-9581-ad364d7be947 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Getting quotas for project f885c9fd8f394c999eee70e8d27180e0. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:22:00.380770 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-b89698d6-7532-47ad-9581-ad364d7be947 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Getting quotas for user 4e949eeed6cd451d8dc5d0877963b260 and project f885c9fd8f394c999eee70e8d27180e0. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:22:00.412839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b89698d6-7532-47ad-9581-ad364d7be947 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.245266 Aug 26 12:22:00.413611 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 424/848] 10.222.0.61 () {60 vars in 1159 bytes} [Fri Aug 26 12:22:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:22:16.670764 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1652085084", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1601804971", "security_groups": [{"name": "tempest-secgroup-smoke-718259694"}], "networks": [{"uuid": "bf630ed1-5f95-4d42-9814-80f83a25e348"}], "block_device_mapping_v2": [{"uuid": "6733c708-fa7b-4861-aa61-d4d62b0af83b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:16.681801 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=19 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:16.682440 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=64 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:16.784813 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] validate_networks() for [('bf630ed1-5f95-4d42-9814-80f83a25e348', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:22:17.143086 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:22:17.143475 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:22:17.143941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:22:17.144339 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:22:17.144741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:22:17.153534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:17.154223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:17.154649 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:17.155907 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:17.156430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:17.156841 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:17.174525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Getting quotas for project f885c9fd8f394c999eee70e8d27180e0. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:22:17.178366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Getting quotas for user 4e949eeed6cd451d8dc5d0877963b260 and project f885c9fd8f394c999eee70e8d27180e0. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:22:17.234234 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:22:17.236327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6733c708-fa7b-4861-aa61-d4d62b0af83b',volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:22:17.363430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-59ff9189-e40c-429f-b12a-4335ffe6a018 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.696152 Aug 26 12:22:17.364260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 425/849] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:22:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:22:17.372411 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=50 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:17.373278 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:17.374084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:17.380349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-04281c1d-93d6-4d77-893a-2f9a1e8bc73f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:17.380994 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-04281c1d-93d6-4d77-893a-2f9a1e8bc73f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:17.434797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-04281c1d-93d6-4d77-893a-2f9a1e8bc73f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:17.443091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-04281c1d-93d6-4d77-893a-2f9a1e8bc73f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1089 microversion: 2.1 time: 0.072184 Aug 26 12:22:17.443687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 425/850] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:17 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:18.466031 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:18.467457 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:18.478447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:18.479759 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:18.480231 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:18.480952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:18.481417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:18.481853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:18.561333 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:18.570563 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a714e34-3d12-485f-9d03-3fb000cc8bbf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1195 microversion: 2.1 time: 0.110659 Aug 26 12:22:18.571561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 426/851] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:18 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1195 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:19.591913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:19.592525 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:19.599000 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:19.599522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:19.599961 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:19.600656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:19.601137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:19.601538 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:19.822408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:19.830245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a6774220-f560-4823-8dc1-d8eb863d9edb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.242264 Aug 26 12:22:19.830822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 426/852] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:19 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:19.870632 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f019c64d-9a99-4e4c-b8bd-eb156943c7cc req-b45e6f37-5eb7-424e-890e-fbb201d116ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc520f61-d2b7-4697-afff-790f21c0cfb7", "tag": "bdb36592-a3cb-4c92-ba6b-c550ed44b5ab"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:19.881519 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f019c64d-9a99-4e4c-b8bd-eb156943c7cc req-b45e6f37-5eb7-424e-890e-fbb201d116ed service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:19.881999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f019c64d-9a99-4e4c-b8bd-eb156943c7cc req-b45e6f37-5eb7-424e-890e-fbb201d116ed service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:19.882423 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f019c64d-9a99-4e4c-b8bd-eb156943c7cc req-b45e6f37-5eb7-424e-890e-fbb201d116ed service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:19.893823 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f019c64d-9a99-4e4c-b8bd-eb156943c7cc req-b45e6f37-5eb7-424e-890e-fbb201d116ed service nova] Creating event network-changed:bdb36592-a3cb-4c92-ba6b-c550ed44b5ab for instance dc520f61-d2b7-4697-afff-790f21c0cfb7 on hv-cinder-84630 Aug 26 12:22:19.898966 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f019c64d-9a99-4e4c-b8bd-eb156943c7cc req-b45e6f37-5eb7-424e-890e-fbb201d116ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032561 Aug 26 12:22:19.899794 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 427/853] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:22:20.851504 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:20.852062 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:20.858017 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:20.858540 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:20.858971 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:20.859679 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:20.860125 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:20.860537 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:21.065616 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:21.073527 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-61d04b10-bb5b-4e85-8035-5410baf2ea97 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.225965 Aug 26 12:22:21.074103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 427/854] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:20 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:22.096107 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:22.096734 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:22.102867 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:22.103395 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:22.103833 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:22.104523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:22.104975 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:22.105399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:22.241287 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:22.248945 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74d65a02-a0c6-48ca-9227-2198dac5bf9f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.158275 Aug 26 12:22:22.250173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 428/855] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:22 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:23.270102 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:23.270756 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:23.277076 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:23.277556 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:23.277981 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:23.278663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:23.279107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:23.279545 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:23.407854 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:23.415441 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0b721b4-505c-47ed-9d93-7a6a3e83ef85 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.149168 Aug 26 12:22:23.416015 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 428/856] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:23 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:24.437329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:24.437934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:24.451577 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:24.452052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:24.452686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:24.453366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:24.453808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:24.454223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:24.590106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:24.598489 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70f5e219-c330-4c1b-840c-bf930f2fbe09 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.165614 Aug 26 12:22:24.599054 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 429/857] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:24 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:25.619397 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:25.620025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:25.627288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:25.627774 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:25.628207 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:25.628892 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:25.629346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:25.629768 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:25.756182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:25.764192 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-21ea4380-126f-4ae0-919c-c5818281183c tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.148618 Aug 26 12:22:25.765263 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 429/858] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:25 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:26.785260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:26.785922 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:26.792367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:26.792848 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:26.793280 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:26.793965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:26.794424 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:26.794840 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:26.928763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:26.937131 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-908c4a05-24c9-4ab1-8231-3aace9d6fb99 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.155190 Aug 26 12:22:26.937693 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 430/859] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:26 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:27.957857 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:27.958462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:27.960817 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:27.966116 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:27.966594 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:27.967022 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:27.967968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:27.968426 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:27.968842 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:28.101771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:28.109907 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-71d4a2dc-2095-4df1-9239-1e0d11af36cc tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.155850 Aug 26 12:22:28.110461 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 430/860] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:27 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:29.130719 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:29.131357 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:29.133262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:29.134055 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:29.140583 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:29.141057 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:29.141483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:29.142163 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:29.142603 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:29.143016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:29.270512 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:29.278160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7dd5aa8-2d8a-42bb-88b0-9ddd7ae3a0a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.151188 Aug 26 12:22:29.278655 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 431/861] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:29 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:30.299645 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:30.300283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:30.306608 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:30.307090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:30.307551 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:30.308244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:30.308699 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:30.309123 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:30.441379 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:30.448967 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-afd60f9c-f52e-4549-a8ec-7b4ef45e01bd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.154137 Aug 26 12:22:30.449530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 431/862] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:30 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:31.469689 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:31.470297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:31.476792 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:31.477266 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:31.477687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:31.478363 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:31.478811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:31.479242 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:31.606520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:31.614880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4024019a-120a-4dac-9af3-68d411675365 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.149167 Aug 26 12:22:31.615469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 432/863] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:31 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:31.899782 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:31.900316 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:31.907018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:31.907536 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:31.907972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:31.908664 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:31.909119 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:31.909571 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:31.938870 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c76b746e-24c5-42d6-8276-02616819438c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments/edb0b4e1-dbd2-4871-b34f-f99a73964d08" status: 200 len: 194 microversion: 2.20 time: 0.043028 Aug 26 12:22:31.939482 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 432/864] 10.222.0.61 () {60 vars in 1454 bytes} [Fri Aug 26 12:22:31 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments/edb0b4e1-dbd2-4871-b34f-f99a73964d08 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:22:32.009124 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:32.009723 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:32.016192 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:32.016680 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:32.017114 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:32.018656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:32.018656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:32.018933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:32.105286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lazy-loading 'services' on Instance uuid f79b22dd-76aa-4cd2-814b-5d61b81a73bd {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:22:32.127873 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-7498b8fe-07ae-428f-8ce0-3d4bbfe7d880 req-6f449a82-71c5-423c-bb8b-a374a82a9947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc520f61-d2b7-4697-afff-790f21c0cfb7", "name": "network-vif-plugged", "status": "completed", "tag": "bdb36592-a3cb-4c92-ba6b-c550ed44b5ab"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:32.138466 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-7498b8fe-07ae-428f-8ce0-3d4bbfe7d880 req-6f449a82-71c5-423c-bb8b-a374a82a9947 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:32.139510 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-7498b8fe-07ae-428f-8ce0-3d4bbfe7d880 req-6f449a82-71c5-423c-bb8b-a374a82a9947 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:32.140107 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-7498b8fe-07ae-428f-8ce0-3d4bbfe7d880 req-6f449a82-71c5-423c-bb8b-a374a82a9947 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:32.153229 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-7498b8fe-07ae-428f-8ce0-3d4bbfe7d880 req-6f449a82-71c5-423c-bb8b-a374a82a9947 service nova] Creating event network-vif-plugged:bdb36592-a3cb-4c92-ba6b-c550ed44b5ab for instance dc520f61-d2b7-4697-afff-790f21c0cfb7 on hv-cinder-84630 Aug 26 12:22:32.158944 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-7498b8fe-07ae-428f-8ce0-3d4bbfe7d880 req-6f449a82-71c5-423c-bb8b-a374a82a9947 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035454 Aug 26 12:22:32.160960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 433/865] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:22:32.192242 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d8a50cc-e125-4e3b-8535-82d415b7efc5 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments/edb0b4e1-dbd2-4871-b34f-f99a73964d08" status: 202 len: 0 microversion: 2.20 time: 0.187564 Aug 26 12:22:32.192828 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 433/866] 10.222.0.61 () {60 vars in 1457 bytes} [Fri Aug 26 12:22:32 2022] DELETE /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments/edb0b4e1-dbd2-4871-b34f-f99a73964d08 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:22:32.202028 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:32.204356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:32.210767 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:32.211285 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:32.211715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:32.212406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:32.212867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:32.213272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:32.245383 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6021b761-c669-4fab-97f8-a746498bd096 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047719 Aug 26 12:22:32.245944 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 434/867] 10.222.0.61 () {60 vars in 1343 bytes} [Fri Aug 26 12:22:32 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:22:32.636908 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:32.637605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:32.643712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:32.644189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:32.644617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:32.645306 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:32.645750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:32.646184 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:32.775758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:32.783862 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9e8bfd1f-edc9-499c-a973-50efb28996b7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.151625 Aug 26 12:22:32.784423 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 434/868] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:32 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:33.258184 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:33.260277 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:33.267169 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:33.267686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:33.268121 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:33.268821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:33.269268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:33.269686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:33.298903 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a853ed87-0b66-4a67-87bf-2fbd10e43117 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044823 Aug 26 12:22:33.299497 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 435/869] 10.222.0.61 () {60 vars in 1343 bytes} [Fri Aug 26 12:22:33 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:22:33.805022 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:33.805627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:33.812586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:33.813062 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:33.813484 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:33.814161 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:33.814629 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:33.815041 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:33.947361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:33.954930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-347cbcb2-3e6c-4d96-acbc-2e4cd594f422 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1260 microversion: 2.1 time: 0.153765 Aug 26 12:22:33.955525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 435/870] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:33 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:34.311216 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:34.313481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:34.319872 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.320355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.320787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:34.321473 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.321927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.322349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:34.350686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-89d77335-90ff-40b9-b74e-62744a9cc9db tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043461 Aug 26 12:22:34.351249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 436/871] 10.222.0.61 () {60 vars in 1343 bytes} [Fri Aug 26 12:22:34 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:34.412078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:34.412567 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:34.418383 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.418859 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.419328 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:34.420008 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.420454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.421616 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:34.445961 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:22:34.519969 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b3ac960-d1e9-4e85-8b78-db3534d1500a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 204 len: 0 microversion: 2.20 time: 0.111349 Aug 26 12:22:34.520828 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 436/872] 10.222.0.61 () {60 vars in 1280 bytes} [Fri Aug 26 12:22:34 2022] DELETE /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 12:22:34.529518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:34.530648 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:34.536602 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.537084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.537518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:34.538205 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.538656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.539078 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:34.671641 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:34.679721 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:34.681183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:34.682332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a0bc3a34-0adb-4071-8272-8776d7ffbfd8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.157039 Aug 26 12:22:34.682884 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 437/873] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:34 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:34.978560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:34.979278 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:34.988018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.988501 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.988942 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:34.989610 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:34.990051 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:34.990462 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:35.119543 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:35.127987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d33b29e-6b0b-48c5-99a4-730eb7ae1cc7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1443 microversion: 2.1 time: 0.154707 Aug 26 12:22:35.128553 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 437/874] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:34 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:35.148299 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:35.148914 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:35.154725 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:35.155262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:35.155743 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:35.156483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:35.156933 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:35.157358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:35.287960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:35.295920 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3544927d-fd4a-4ba0-a06e-b7d1c85deb1d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1443 microversion: 2.1 time: 0.151261 Aug 26 12:22:35.296574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 438/875] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:22:35 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:22:35.705317 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:35.705931 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:35.711890 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:35.712372 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:35.712808 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:35.713504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:35.713954 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:35.714377 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:36.137050 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:36.146650 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:36.148319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:36.149587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7d30214-27df-4199-afd1-114ee4e4c5f2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1724 microversion: 2.20 time: 0.448593 Aug 26 12:22:36.150180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 438/876] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:35 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:37.171656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:37.172219 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:37.178959 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:37.179332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:37.179762 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:37.180478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:37.180929 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:37.181364 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:37.266251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:37.275631 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:37.277160 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:37.278325 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-257c4d71-81f6-47ad-a005-eefc1217f5e1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1656 microversion: 2.20 time: 0.110781 Aug 26 12:22:37.278893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 439/877] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:37 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1656 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:37.825492 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f58bc377-0f7b-43ec-b9d3-247d2c8f15e4 req-44ffa56b-a2fe-4a37-8e9e-00bb7def2df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79b22dd-76aa-4cd2-814b-5d61b81a73bd", "name": "network-vif-deleted", "tag": "6d70c9aa-09a0-4252-9c28-50bff97caa6f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:37.837413 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f58bc377-0f7b-43ec-b9d3-247d2c8f15e4 req-44ffa56b-a2fe-4a37-8e9e-00bb7def2df3 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:37.838292 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f58bc377-0f7b-43ec-b9d3-247d2c8f15e4 req-44ffa56b-a2fe-4a37-8e9e-00bb7def2df3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:37.838955 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f58bc377-0f7b-43ec-b9d3-247d2c8f15e4 req-44ffa56b-a2fe-4a37-8e9e-00bb7def2df3 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:37.853837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f58bc377-0f7b-43ec-b9d3-247d2c8f15e4 req-44ffa56b-a2fe-4a37-8e9e-00bb7def2df3 service nova] Creating event network-vif-deleted:6d70c9aa-09a0-4252-9c28-50bff97caa6f for instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd on hv-cinder-84630 Aug 26 12:22:37.859256 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f58bc377-0f7b-43ec-b9d3-247d2c8f15e4 req-44ffa56b-a2fe-4a37-8e9e-00bb7def2df3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040188 Aug 26 12:22:37.860110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 439/878] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:22:38.301965 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:38.302620 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:38.312510 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:38.316025 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:38.316661 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:38.317801 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:38.318544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:38.319141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:38.355513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:38.356821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:38.357611 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:38.358929 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lazy-loading 'fault' on Instance uuid f79b22dd-76aa-4cd2-814b-5d61b81a73bd {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:22:38.407371 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:38.416560 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:38.418019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:38.419189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4b79c54c-d516-47e6-aae9-f980805f2a40 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 200 len: 1371 microversion: 2.20 time: 0.121063 Aug 26 12:22:38.420313 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 440/879] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:38 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:39.443337 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:39.444040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:39.450384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:39.450875 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:39.451337 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:39.452623 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:39.453493 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:39.453493 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:39.468195 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] HTTP exception thrown: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Request method failure captured: Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd HTTP/1.1 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLpm5tL1mN-57rNajcF6d3ur8vWaaj-wmuS5qsYnK7EkS0nsswm-SaB0Pya0aQTDsDsAIR5rnSCCBiyNaxfBQSKLaWDN2RvKneFtsbwJlngHtThGUmm2Kxq1LhehpukGf1QPIfz_AQPmgHUF2KLfKKJeKlC0Ftdkh3TOYCwiOvjlbr0 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:22:39.469845 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4583d65a595463b97e8dfabbf3da521", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 0e013faf32b84179989eb99be958555f Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:22:39.471686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'f79b22dd-76aa-4cd2-814b-5d61b81a73bd'} Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:22:39.472839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:22:39.474399 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:22:39.476283 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Returning 404 to user: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:22:39.476283 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c387bf3-da54-4428-8a8f-2788c0e43c87 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 404 len: 111 microversion: 2.20 time: 0.032865 Aug 26 12:22:39.476283 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 440/880] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:39 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:22:39.480149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff2a85f5-d500-4e1b-9286-e39aed152e04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '.version_select at 0x7ffa97699ca0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:39.500148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ff2a85f5-d500-4e1b-9286-e39aed152e04 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408346414" status: 204 len: 0 microversion: 2.20 time: 0.023862 Aug 26 12:22:39.500718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 441/881] 10.222.0.61 () {60 vars in 1259 bytes} [Fri Aug 26 12:22:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408346414 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 12:22:40.097793 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ffa3ea4-5994-4e01-805c-d8945a540938 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'create', calling method: .version_select at 0x7ffa97649700>, body: {"keypair": {"name": "tempest-keypair-1114687597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWdOAUf3aQhM2vJItTinpBlNTafE1y9MZ9swWRJ6CqaxX7wIql+oeo94tUZahqheNdaGRvfWmIKS7IrRBeTPQ6+v+4uk3gZmb2+XhNvAzCSif9a1vN6kihs18nvpSG/wQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:40.113176 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-8ffa3ea4-5994-4e01-805c-d8945a540938 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for project f4583d65a595463b97e8dfabbf3da521. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:22:40.116970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-8ffa3ea4-5994-4e01-805c-d8945a540938 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for user 0e013faf32b84179989eb99be958555f and project f4583d65a595463b97e8dfabbf3da521. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:22:40.120718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-6e92fe53-3bd0-4857-a710-884f8df2653b req-3f9a18d4-112b-4a9e-b1ad-73ee9cf6a571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc520f61-d2b7-4697-afff-790f21c0cfb7", "tag": "bdb36592-a3cb-4c92-ba6b-c550ed44b5ab"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:40.131777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6e92fe53-3bd0-4857-a710-884f8df2653b req-3f9a18d4-112b-4a9e-b1ad-73ee9cf6a571 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:40.132533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6e92fe53-3bd0-4857-a710-884f8df2653b req-3f9a18d4-112b-4a9e-b1ad-73ee9cf6a571 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:40.132970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6e92fe53-3bd0-4857-a710-884f8df2653b req-3f9a18d4-112b-4a9e-b1ad-73ee9cf6a571 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:40.139093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ffa3ea4-5994-4e01-805c-d8945a540938 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045209 Aug 26 12:22:40.140421 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 441/882] 10.222.0.61 () {62 vars in 1200 bytes} [Fri Aug 26 12:22:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 26 12:22:40.146512 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6e92fe53-3bd0-4857-a710-884f8df2653b req-3f9a18d4-112b-4a9e-b1ad-73ee9cf6a571 service nova] Creating event network-changed:bdb36592-a3cb-4c92-ba6b-c550ed44b5ab for instance dc520f61-d2b7-4697-afff-790f21c0cfb7 on hv-cinder-84630 Aug 26 12:22:40.151694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-6e92fe53-3bd0-4857-a710-884f8df2653b req-3f9a18d4-112b-4a9e-b1ad-73ee9cf6a571 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034628 Aug 26 12:22:40.152645 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 442/883] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:22:41.524958 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-395419322", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a9c1701-9f05-4cb0-be4d-041018795491"}], "security_groups": [{"name": "tempest-securitygroup--1161134661"}], "key_name": "tempest-keypair-1114687597", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:41.625701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] validate_networks() for [('5a9c1701-9f05-4cb0-be4d-041018795491', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:22:41.986140 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:22:41.986560 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:22:41.987038 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:22:41.987725 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:22:41.988134 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:22:41.997271 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:41.997752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:41.998181 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:41.999425 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:41.999880 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:42.000299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:42.017512 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for project f4583d65a595463b97e8dfabbf3da521. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:22:42.021454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Getting quotas for user 0e013faf32b84179989eb99be958555f and project f4583d65a595463b97e8dfabbf3da521. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:22:42.032534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:22:42.034827 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:22:42.081355 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cad458c2-39c9-42fc-9d3b-62d7e44f0238 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.561280 Aug 26 12:22:42.081992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 442/884] 10.222.0.61 () {62 vars in 1188 bytes} [Fri Aug 26 12:22:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 26 12:22:42.093389 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e8aa6956-7799-4728-a331-754acf011805 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:42.094082 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e8aa6956-7799-4728-a331-754acf011805 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:42.151398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e8aa6956-7799-4728-a331-754acf011805 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:42.159110 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e8aa6956-7799-4728-a331-754acf011805 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:42.160613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e8aa6956-7799-4728-a331-754acf011805 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:42.161735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e8aa6956-7799-4728-a331-754acf011805 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1281 microversion: 2.20 time: 0.072579 Aug 26 12:22:42.162288 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 443/885] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:42 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:43.190020 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:43.191004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:43.198750 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:43.199262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:43.199691 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:43.200446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:43.200893 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:43.201307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:43.220625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:43.279043 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:43.287861 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:43.289331 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:43.290725 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c5f6f548-c9d4-4ddc-833b-a112af14e0aa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1341 microversion: 2.20 time: 0.108264 Aug 26 12:22:43.291512 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 443/886] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:43 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1341 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:44.314225 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:44.314837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:44.322264 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:44.322748 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:44.323186 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:44.323905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:44.324362 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:44.324786 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:44.546641 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:44.557820 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:44.560807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:44.562899 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5a44948f-11a3-43ce-9cb4-f79f783aba2e tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1407 microversion: 2.20 time: 0.252544 Aug 26 12:22:44.563994 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 444/887] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:44 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:44.645685 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b88a04e6-5810-4edf-b6da-2bc1bcba537f req-11981140-8ac7-483e-85a7-a66bffbb64ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d12d93c-1a7e-4c71-a2b0-c380b5d706e9", "tag": "717a8a96-49f7-4b89-98a4-3ef8aa78066c"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:44.659870 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b88a04e6-5810-4edf-b6da-2bc1bcba537f req-11981140-8ac7-483e-85a7-a66bffbb64ee service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:44.660683 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b88a04e6-5810-4edf-b6da-2bc1bcba537f req-11981140-8ac7-483e-85a7-a66bffbb64ee service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:44.661112 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b88a04e6-5810-4edf-b6da-2bc1bcba537f req-11981140-8ac7-483e-85a7-a66bffbb64ee service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:44.673770 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b88a04e6-5810-4edf-b6da-2bc1bcba537f req-11981140-8ac7-483e-85a7-a66bffbb64ee service nova] Creating event network-changed:717a8a96-49f7-4b89-98a4-3ef8aa78066c for instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 on hv-cinder-84630 Aug 26 12:22:44.679265 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b88a04e6-5810-4edf-b6da-2bc1bcba537f req-11981140-8ac7-483e-85a7-a66bffbb64ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037323 Aug 26 12:22:44.679864 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 444/888] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:22:45.587540 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:45.588144 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:45.594520 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:45.594993 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:45.595523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:45.596205 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:45.596655 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:45.597071 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:45.616183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:45.724552 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:45.732512 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:45.734018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:45.735108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-78dccd70-3d50-40d4-b1b1-b905188e4079 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1407 microversion: 2.20 time: 0.151454 Aug 26 12:22:45.735707 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 445/889] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:45 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:46.758511 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:46.759217 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:46.761614 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:46.766972 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:46.767475 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:46.767909 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:46.768599 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:46.769044 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:46.769464 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:46.900608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:46.909075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:46.910527 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:46.911682 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1efbc2e0-23e0-44c7-8a31-93842906f6fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1407 microversion: 2.20 time: 0.157470 Aug 26 12:22:46.912233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 445/890] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:46 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:22:47.934241 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:47.934832 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:47.937703 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:47.944105 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:47.944778 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:47.945247 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:47.945942 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:47.946397 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:47.946823 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:48.078303 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:48.087939 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:48.089403 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:48.090786 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a85c2486-a63c-4d25-89b6-8647fd5ae6cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1407 microversion: 2.20 time: 0.160552 Aug 26 12:22:48.091570 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 446/891] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:47 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:49.114305 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:49.114914 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:49.121614 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:49.122091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:49.122524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:49.123227 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:49.124300 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:49.124678 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:49.249358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:49.257391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:49.258863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:49.259991 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4fcf247c-2eea-4cb9-aadb-734421649243 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1407 microversion: 2.20 time: 0.149845 Aug 26 12:22:49.260543 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 446/892] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:49 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:50.166367 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-f7bfb096-dc25-4435-a41b-70fec0ccbdef req-6af7fb9a-46e9-4e19-9f8f-c66755e0020c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d12d93c-1a7e-4c71-a2b0-c380b5d706e9", "name": "network-vif-plugged", "status": "completed", "tag": "717a8a96-49f7-4b89-98a4-3ef8aa78066c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:50.178128 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f7bfb096-dc25-4435-a41b-70fec0ccbdef req-6af7fb9a-46e9-4e19-9f8f-c66755e0020c service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:50.178769 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f7bfb096-dc25-4435-a41b-70fec0ccbdef req-6af7fb9a-46e9-4e19-9f8f-c66755e0020c service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:50.179245 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f7bfb096-dc25-4435-a41b-70fec0ccbdef req-6af7fb9a-46e9-4e19-9f8f-c66755e0020c service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:50.190559 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-f7bfb096-dc25-4435-a41b-70fec0ccbdef req-6af7fb9a-46e9-4e19-9f8f-c66755e0020c service nova] Creating event network-vif-plugged:717a8a96-49f7-4b89-98a4-3ef8aa78066c for instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 on hv-cinder-84630 Aug 26 12:22:50.195535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-f7bfb096-dc25-4435-a41b-70fec0ccbdef req-6af7fb9a-46e9-4e19-9f8f-c66755e0020c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032865 Aug 26 12:22:50.196125 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 447/893] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:22:50.281979 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:50.282811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:50.289439 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:50.290004 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:50.290514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:50.291344 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:50.291871 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:50.292324 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:50.479491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:50.488250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:50.489689 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:50.490779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5465c5f-ff1e-42f1-bf66-f11aba93114b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1407 microversion: 2.20 time: 0.212738 Aug 26 12:22:50.491350 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 447/894] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:50 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:51.513842 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:51.515391 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:51.522428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:51.522918 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:51.523386 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:51.524091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:51.524543 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:51.524968 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:51.656909 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:51.665066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:51.666526 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:51.667720 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4487db92-a6af-4692-9069-9b7a2f09d1a1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1407 microversion: 2.20 time: 0.158100 Aug 26 12:22:51.668281 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 448/895] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:51 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:22:52.690018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:52.690617 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:52.692937 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:52.693578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:52.698997 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:52.699509 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:52.699938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:52.700616 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:52.701088 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:52.702018 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:52.831438 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:52.839807 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:52.841268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:22:52.843059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3c4b813-1c8d-469d-b27a-2fc45f850613 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1598 microversion: 2.20 time: 0.156426 Aug 26 12:22:52.843653 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 448/896] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:22:52 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:22:52.866926 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:22:52.867454 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:22:52.869410 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:22:52.875109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:52.875613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:52.876048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:52.876734 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:52.877187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:52.877610 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:52.952935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cb45e6c2-037c-4f58-8301-455604356370 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090120 Aug 26 12:22:52.953519 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 449/897] 10.222.0.61 () {60 vars in 1316 bytes} [Fri Aug 26 12:22:52 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:22:54.082183 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8214d75b-43e8-4469-87ed-abfce240bd9d req-6b223e26-933a-4d96-95ea-8351a4721a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d12d93c-1a7e-4c71-a2b0-c380b5d706e9", "tag": "717a8a96-49f7-4b89-98a4-3ef8aa78066c"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:22:54.091999 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8214d75b-43e8-4469-87ed-abfce240bd9d req-6b223e26-933a-4d96-95ea-8351a4721a37 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:22:54.093338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8214d75b-43e8-4469-87ed-abfce240bd9d req-6b223e26-933a-4d96-95ea-8351a4721a37 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:22:54.093886 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8214d75b-43e8-4469-87ed-abfce240bd9d req-6b223e26-933a-4d96-95ea-8351a4721a37 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:22:54.104712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8214d75b-43e8-4469-87ed-abfce240bd9d req-6b223e26-933a-4d96-95ea-8351a4721a37 service nova] Creating event network-changed:717a8a96-49f7-4b89-98a4-3ef8aa78066c for instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 on hv-cinder-84630 Aug 26 12:22:54.110248 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8214d75b-43e8-4469-87ed-abfce240bd9d req-6b223e26-933a-4d96-95ea-8351a4721a37 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031797 Aug 26 12:22:54.110829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 449/898] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:23:30.316184 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=7 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:23:30.316965 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=20 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:23:30.320877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:30.321365 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:30.328777 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:30.329258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:30.329688 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:30.330371 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:30.330821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:30.331277 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:30.354347 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-05ceed00-cbfd-40d6-8e45-1564255f1239 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/ips" status: 200 len: 150 microversion: 2.20 time: 0.039854 Aug 26 12:23:30.354910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 450/899] 10.222.0.61 () {60 vars in 1289 bytes} [Fri Aug 26 12:23:30 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:23:32.827422 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=9 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:23:32.828207 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=30 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:23:32.832412 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:23:32.833064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:32.839986 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:32.840466 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:32.840898 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:32.841581 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:32.842031 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:32.842971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:32.866732 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lazy-loading 'flavor' on Instance uuid 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:23:33.039340 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2b84ee2-99d0-46e0-bbf5-e614960e7eb2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/action" status: 202 len: 0 microversion: 2.20 time: 0.213823 Aug 26 12:23:33.039924 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 450/900] 10.222.0.61 () {62 vars in 1319 bytes} [Fri Aug 26 12:23:32 2022] POST /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:23:33.048838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:33.049445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:33.055837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:33.056394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:33.056760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:33.057554 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:33.058023 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:33.058511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:33.190484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:33.198535 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:33.200008 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:33.201158 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3673f0ff-a32e-479d-9814-c1fd8e9d81fe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.157108 Aug 26 12:23:33.202232 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 451/901] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:33 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:34.225759 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:34.226445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:34.234020 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:34.234490 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:34.234915 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:34.235622 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:34.236065 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:34.236491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:34.362680 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:34.370694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:34.372456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:34.373642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40a0c563-370b-46d3-932d-f4a6eb7907bc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.152588 Aug 26 12:23:34.374152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 451/902] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:34 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:35.395973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:35.396614 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:35.402952 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:35.403467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:35.403901 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:35.404590 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:35.405064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:35.405488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:35.532663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:35.540639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:35.542091 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:35.543287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-88b0b8f5-4a15-4544-b1e8-361710e3636c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.151223 Aug 26 12:23:35.543846 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 452/903] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:35 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:36.566302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:36.566854 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:36.572781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:36.573253 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:36.573679 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:36.574353 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:36.574796 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:36.575220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:36.705180 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:36.713091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:36.714523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:36.715691 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d89cea16-ec55-4802-90e6-f29461c2c8cc tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.153509 Aug 26 12:23:36.716244 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 452/904] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:36 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:23:37.737883 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:37.738539 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:37.744970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:37.745453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:37.745888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:37.746586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:37.747035 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:37.747478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:37.874171 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:37.882237 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:37.883711 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:37.884861 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-06b64885-9aec-491d-aa51-07bea040f999 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.151129 Aug 26 12:23:37.885412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 453/905] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:37 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:38.907649 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:38.908239 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:38.914545 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:38.915020 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:38.915474 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:38.916155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:38.916597 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:38.917289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:39.046730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:39.054831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:39.056299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:39.057479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f087d75f-371b-4c04-8448-8d4781810189 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.154584 Aug 26 12:23:39.058028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 453/906] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:38 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:40.080954 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:40.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:40.087864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:40.088346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:40.088782 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:40.089472 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:40.089932 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:40.090356 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:40.216459 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:40.224484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:40.225948 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:40.227108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-32ee0493-f3e1-403a-8b0a-362131e04f43 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.150857 Aug 26 12:23:40.227712 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 454/907] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:40 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:41.249919 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:41.250524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:41.256960 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:41.257445 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:41.257875 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:41.258559 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:41.259010 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:41.259460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:41.385311 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:41.393277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:41.394712 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:41.395881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f015e423-a152-4e09-8977-7afe8771a1f7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.150566 Aug 26 12:23:41.396429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 454/908] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:41 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:42.417866 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:42.418497 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:42.425082 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:42.425563 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:42.425998 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:42.426690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:42.427143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:42.427593 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:42.557058 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:42.565805 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:42.567283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:42.568430 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7123a349-b953-41f4-b3d7-1a70ff6c13cf tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.154507 Aug 26 12:23:42.568985 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 455/909] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:42 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:43.589839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:43.590429 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:43.597743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:43.598220 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:43.598651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:43.599358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:43.599812 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:43.600234 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:43.725480 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:43.733625 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:43.735078 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:43.736257 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-72c80f1b-af83-457e-a0b1-96434dbcb940 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1743 microversion: 2.20 time: 0.150334 Aug 26 12:23:43.737059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 455/910] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:43 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:44.760240 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:44.760848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:44.767929 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:44.768412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:44.768847 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:44.769534 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:44.769984 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:44.770407 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:44.900903 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:44.909653 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:44.911089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:44.912292 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d3f6a48d-0f95-49e7-874f-0d558b6f2f90 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1743 microversion: 2.20 time: 0.156040 Aug 26 12:23:44.912848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 456/911] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:44 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:45.934165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:45.934766 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:45.941588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:45.942145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:45.942645 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:45.943446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:45.944152 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:45.944844 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:46.098512 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:46.108767 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:46.110534 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:46.113338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7a48e4a-1784-40e3-a166-e70bb3b8df0a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.182583 Aug 26 12:23:46.114551 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 456/912] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:45 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:47.137193 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:47.137800 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:47.144126 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:47.144858 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:47.145293 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:47.146010 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:47.146572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:47.146894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:47.288353 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:47.297764 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:47.299249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:47.300549 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4b4139b6-580c-4420-998c-31be1f573b41 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.167248 Aug 26 12:23:47.301320 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 457/913] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:47 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:48.323864 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:48.325181 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:48.332254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:48.334879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:48.334879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:48.334879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:48.334879 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:48.335656 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:48.410715 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-535a4ca4-c25a-47c3-a2dc-f97214794db8 req-4ca3fe2d-5f81-459d-8c6a-209c8fd1e4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d12d93c-1a7e-4c71-a2b0-c380b5d706e9", "name": "network-vif-plugged", "status": "completed", "tag": "717a8a96-49f7-4b89-98a4-3ef8aa78066c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:23:48.425645 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-535a4ca4-c25a-47c3-a2dc-f97214794db8 req-4ca3fe2d-5f81-459d-8c6a-209c8fd1e4cd service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:48.429457 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-535a4ca4-c25a-47c3-a2dc-f97214794db8 req-4ca3fe2d-5f81-459d-8c6a-209c8fd1e4cd service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:48.431368 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-535a4ca4-c25a-47c3-a2dc-f97214794db8 req-4ca3fe2d-5f81-459d-8c6a-209c8fd1e4cd service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:48.455515 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-535a4ca4-c25a-47c3-a2dc-f97214794db8 req-4ca3fe2d-5f81-459d-8c6a-209c8fd1e4cd service nova] Creating event network-vif-plugged:717a8a96-49f7-4b89-98a4-3ef8aa78066c for instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 on hv-cinder-84630 Aug 26 12:23:48.460936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-535a4ca4-c25a-47c3-a2dc-f97214794db8 req-4ca3fe2d-5f81-459d-8c6a-209c8fd1e4cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054654 Aug 26 12:23:48.462140 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 458/914] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:23:48.512006 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:48.521504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:48.522983 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:48.524361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2df9bbda-b8d1-4db2-b487-5d8a15bbbf2a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.204776 Aug 26 12:23:48.525080 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 457/915] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:48 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:49.548736 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:49.549436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:49.556818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:49.557413 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:49.557923 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:49.558705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:49.559238 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:49.559760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:49.707180 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:49.716184 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:49.717683 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:49.718875 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f28e56a7-559e-4d20-b47d-8c7dfa10cffb tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.174623 Aug 26 12:23:49.734018 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 459/916] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:49 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:50.760250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:50.761679 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:50.769565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:50.770367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:50.770919 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:50.771930 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:50.772452 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:50.773024 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:50.925928 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:50.934182 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:50.936286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:50.939491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6bb8b43-5d28-48ef-8f43-6547e6b09798 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.200184 Aug 26 12:23:50.940605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 458/917] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:50 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:51.964316 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:51.964992 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:51.972069 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:51.972544 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:51.973605 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:51.975249 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:51.975702 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:51.976126 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:52.122970 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:52.133267 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:52.135499 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:52.137995 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-093dfea0-801c-4717-b960-162f37f6c4c1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.176870 Aug 26 12:23:52.138695 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 460/918] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:51 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:53.161523 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:53.162111 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:53.169405 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:53.169978 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:53.170461 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:53.171265 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:53.171718 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:53.172136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:53.316075 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:53.324811 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:53.326926 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:53.328158 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46ea7b3f-9606-419a-9776-aff847b46998 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.170499 Aug 26 12:23:53.331277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 459/919] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:53 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:54.351313 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:54.351909 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:54.358846 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:54.359357 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:54.359825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:54.360467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:54.360910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:54.361328 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:54.490427 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:54.498524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:54.500062 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:54.501206 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c7db99bb-7384-4e3d-b7cb-f0859020afa4 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1738 microversion: 2.20 time: 0.153772 Aug 26 12:23:54.501753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 461/920] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:54 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:55.524186 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:55.525019 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:55.531578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:55.532066 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:55.532500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:55.533193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:55.533644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:55.534067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:55.661787 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:55.669798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:55.671803 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:55.672944 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35a873a8-3c72-4194-b7d7-59bd0739318f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1720 microversion: 2.20 time: 0.152726 Aug 26 12:23:55.673491 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 460/921] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:55 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:56.695310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:56.695915 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:56.703012 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:56.703503 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:56.703927 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:56.704601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:56.705049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:56.705462 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:56.834710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:56.842633 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:56.844090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:56.845259 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7dcc8e16-0091-48f6-8ce6-a13565f990c2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1720 microversion: 2.20 time: 0.153872 Aug 26 12:23:56.845815 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 462/922] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:56 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:57.868479 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:57.869500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:57.876443 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:57.876941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:57.877372 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:57.878060 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:57.878509 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:57.878966 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.004951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:58.013150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:58.015223 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:58.016381 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-247c8c32-aa48-48c0-b97c-1f403ce5084c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1663 microversion: 2.20 time: 0.151865 Aug 26 12:23:58.016933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 461/923] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:57 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:23:58.040482 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "729d0347-d685-4dd8-9350-a463f832a79d"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:23:58.042827 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:58.049210 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.049690 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.050122 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.050837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.051314 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.051862 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.317272 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-045c2083-1b01-4439-887a-de109b388f8f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280846 Aug 26 12:23:58.323269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 463/924] 10.222.0.61 () {62 vars in 1364 bytes} [Fri Aug 26 12:23:58 2022] POST /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 26 12:23:58.390932 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6124599a-2c74-4933-b5e8-dd26ccf0aebc req-6b72fe54-a771-406b-8cd0-27036e26bc46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d12d93c-1a7e-4c71-a2b0-c380b5d706e9", "name": "network-vif-unplugged", "status": "completed", "tag": "717a8a96-49f7-4b89-98a4-3ef8aa78066c"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:23:58.402918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6124599a-2c74-4933-b5e8-dd26ccf0aebc req-6b72fe54-a771-406b-8cd0-27036e26bc46 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.403535 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6124599a-2c74-4933-b5e8-dd26ccf0aebc req-6b72fe54-a771-406b-8cd0-27036e26bc46 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.403874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6124599a-2c74-4933-b5e8-dd26ccf0aebc req-6b72fe54-a771-406b-8cd0-27036e26bc46 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.415959 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.server_external_events [req-6124599a-2c74-4933-b5e8-dd26ccf0aebc req-6b72fe54-a771-406b-8cd0-27036e26bc46 service nova] Unable to find a host for instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9. Dropping event network-vif-unplugged {{(pid=120698) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 26 12:23:58.416835 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6124599a-2c74-4933-b5e8-dd26ccf0aebc req-6b72fe54-a771-406b-8cd0-27036e26bc46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029718 Aug 26 12:23:58.417769 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 462/925] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 26 12:23:58.444394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:58.444886 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:58.450685 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.451168 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.451626 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.452312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.452775 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.453192 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.530350 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:23:58.683877 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2dd93bb2-7f2e-47fc-8f00-948647076195 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-volume_attachments/729d0347-d685-4dd8-9350-a463f832a79d" status: 202 len: 0 microversion: 2.20 time: 0.243512 Aug 26 12:23:58.684472 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 464/926] 10.222.0.61 () {60 vars in 1457 bytes} [Fri Aug 26 12:23:58 2022] DELETE /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-volume_attachments/729d0347-d685-4dd8-9350-a463f832a79d => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:23:58.743218 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:23:58.744212 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:58.750713 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.751276 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.751658 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.752351 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.752803 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.753225 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.781988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 12:23:58.848205 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a9d19d1-526a-4561-a18b-75942757dbf7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "POST /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/action" status: 202 len: 0 microversion: 2.20 time: 0.108871 Aug 26 12:23:58.848804 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 463/927] 10.222.0.61 () {62 vars in 1319 bytes} [Fri Aug 26 12:23:58 2022] POST /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:23:58.857009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:23:58.858295 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:23:58.865236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.865718 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.866146 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:58.866836 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:23:58.867459 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:23:58.867999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:23:59.006476 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:59.015242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:59.016716 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:23:59.017872 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-48c3203a-aa89-4509-bee7-131d34f2525b tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1671 microversion: 2.20 time: 0.164931 Aug 26 12:23:59.018429 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 465/928] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:23:58 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:00.041233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:00.041846 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:00.048365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:00.048850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:00.049279 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:00.049970 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:00.050418 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:00.051030 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:00.055115 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:00.180269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:00.188537 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:00.189987 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:00.191143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17210ab6-37d4-4a1c-bded-85160744673d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.154398 Aug 26 12:24:00.191724 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 464/929] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:00 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:01.214023 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:01.214626 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:01.217029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=33 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:01.222728 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:01.223271 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:01.223704 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:01.224443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:01.224890 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:01.225309 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:01.356357 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:01.365920 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:01.367618 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:01.368793 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d45606a9-d683-4ec4-bbd0-e34e335150c8 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.158700 Aug 26 12:24:01.369343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 466/930] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:01 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 26 12:24:02.392980 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:02.393680 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:02.400888 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:02.401456 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:02.401976 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:02.402758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:02.403299 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:02.403815 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:02.556856 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:02.565651 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:02.567093 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:02.568296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7569c135-b540-4717-8d2d-2004b5227564 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.179912 Aug 26 12:24:02.568853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 465/931] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:02 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:03.590657 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:03.591222 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:03.597524 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:03.598005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:03.598437 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:03.599144 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:03.599732 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:03.600006 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:03.742749 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:03.754586 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:03.756141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:03.757478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c2b7f644-334d-4b4c-8e96-3bb7479bb361 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.170754 Aug 26 12:24:03.758038 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 467/932] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:03 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:04.781059 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:04.781777 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:04.784120 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:04.789588 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:04.790076 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:04.791565 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:04.792642 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:04.793335 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:04.793983 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:04.952289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:04.963430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:04.965055 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:04.966259 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-846577d0-9b50-4529-9b69-f354a52c8040 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.189529 Aug 26 12:24:04.968116 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 466/933] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:04 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:05.991301 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:05.991954 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:05.998337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:05.998755 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:05.999182 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:05.999913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:06.000358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:06.000772 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:06.137741 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:06.146453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:06.147937 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:06.149094 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6c7ddbdf-22eb-4d4e-b0c7-bc1b4e2a8527 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.161709 Aug 26 12:24:06.149656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 468/934] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:05 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:07.172455 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:07.173047 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:07.179126 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:07.179717 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:07.180069 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:07.180773 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:07.181210 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:07.181626 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:07.333141 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:07.341143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:07.343455 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:07.344607 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-609f4c9f-e42d-480d-af54-6342c015009c tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.176800 Aug 26 12:24:07.345169 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 467/935] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:07 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:08.367410 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:08.368074 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:08.375242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:08.375737 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:08.376170 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:08.376864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:08.377312 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:08.377731 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:08.573451 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:08.581646 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:08.583084 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:08.584304 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d5431872-72d5-4467-acf4-b359d0f32787 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.220864 Aug 26 12:24:08.584856 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 469/936] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:08 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:09.607330 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:09.608029 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:09.614638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:09.615116 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:09.615575 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:09.616254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:09.616708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:09.617125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:09.744730 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:09.753277 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:09.754727 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:09.755934 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a02f6c2b-ed03-4ac3-84ce-0201018d406f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.152655 Aug 26 12:24:09.756514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 468/937] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:09 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:10.779554 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:10.780237 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:10.786637 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:10.787592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:10.787592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:10.788254 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:10.788831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:10.789274 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:10.939997 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:10.948144 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:10.949599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:10.951414 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fae5217e-290a-4af1-830e-d14743eb23fa tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.175842 Aug 26 12:24:10.952168 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 470/938] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:10 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:11.976923 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:11.977530 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:11.984524 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:11.985173 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:11.985608 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:11.986286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:11.986996 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:11.987439 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:12.162619 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:12.170678 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:12.172160 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:12.173312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c58b570-8f45-493b-9f9a-5f801399621d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.200338 Aug 26 12:24:12.173868 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 469/939] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:11 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:13.195976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:13.196583 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:13.203371 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:13.203851 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:13.204287 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:13.204971 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:13.205428 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:13.205848 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:13.331494 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:13.339668 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:13.341615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:13.342818 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3aa9b0f3-da95-4d96-b358-448290c03646 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.150772 Aug 26 12:24:13.343406 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 471/940] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:13 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:14.366533 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:14.367336 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:14.374379 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:14.374864 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:14.375322 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:14.376017 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:14.376473 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:14.376919 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:14.511702 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:14.519527 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-ec237c9e-0f48-4408-89c8-243726046c91 req-a12176f3-1f70-475a-880d-c166f90c034e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d12d93c-1a7e-4c71-a2b0-c380b5d706e9", "name": "network-vif-plugged", "status": "completed", "tag": "717a8a96-49f7-4b89-98a4-3ef8aa78066c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:24:14.520480 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:14.521955 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:14.523127 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84c26645-4cdc-497e-bde8-e008fc395efe tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.160618 Aug 26 12:24:14.529949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ec237c9e-0f48-4408-89c8-243726046c91 req-a12176f3-1f70-475a-880d-c166f90c034e service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:14.531141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ec237c9e-0f48-4408-89c8-243726046c91 req-a12176f3-1f70-475a-880d-c166f90c034e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:14.531141 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-ec237c9e-0f48-4408-89c8-243726046c91 req-a12176f3-1f70-475a-880d-c166f90c034e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:14.536738 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 470/941] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:14 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:14.546604 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-ec237c9e-0f48-4408-89c8-243726046c91 req-a12176f3-1f70-475a-880d-c166f90c034e service nova] Creating event network-vif-plugged:717a8a96-49f7-4b89-98a4-3ef8aa78066c for instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 on hv-cinder-84630 Aug 26 12:24:14.551602 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-ec237c9e-0f48-4408-89c8-243726046c91 req-a12176f3-1f70-475a-880d-c166f90c034e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035779 Aug 26 12:24:14.552201 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 472/942] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:24:15.547701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:15.548309 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:15.554752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:15.555254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:15.555698 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:15.556380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:15.556829 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:15.557249 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:15.687366 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:15.695372 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:15.696817 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:15.697968 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8ade977-64e2-43dc-bae8-b7d27f05403d tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1729 microversion: 2.20 time: 0.154412 Aug 26 12:24:15.698525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 471/943] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:15 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:16.723686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:16.724385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:16.730425 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:16.730905 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:16.731375 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:16.732062 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:16.732601 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:16.733024 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:16.866855 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:16.875169 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:16.876650 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:16.877808 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7912a183-b9cd-4b09-90d9-b90d29ab3dc9 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1716 microversion: 2.20 time: 0.159040 Aug 26 12:24:16.878372 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 473/944] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:16 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:33.578450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:24:33.578977 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:33.581381 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=11 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:33.582147 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=46 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:33.588147 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:33.588624 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:33.589055 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:33.589748 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:33.590195 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:33.590615 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:33.612892 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lazy-loading 'flavor' on Instance uuid dc520f61-d2b7-4697-afff-790f21c0cfb7 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:24:33.683926 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5be9b817-1b0d-4b8d-a7c6-8e679d289611 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "POST /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7/action" status: 202 len: 0 microversion: 2.1 time: 0.109908 Aug 26 12:24:33.684504 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 472/945] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:24:33 2022] POST /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:24:33.693831 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:33.694533 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:33.697048 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=15 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:33.697710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:33.699360 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 26 12:24:33.699558 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Fri Aug 26 12:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 (ip 10.222.0.61) !!! Aug 26 12:24:33.708528 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:33.709118 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:33.709642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:33.710344 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:33.710798 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:33.711248 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:33.853309 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:33.861816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ad81bf1b-a89e-4088-8b29-2b304aa46baf tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.171875 Aug 26 12:24:33.862378 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 474/946] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:33 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:34.884261 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:34.885009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:34.892774 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:34.893250 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:34.893681 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:34.894364 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:34.894813 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:34.895253 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:35.028586 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:35.037091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8dd1942e-7b3c-463e-aecb-212e955c0def tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.157569 Aug 26 12:24:35.037667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 473/947] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:34 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:24:36.058236 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:36.058771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:36.065349 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:36.065830 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:36.066258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:36.066969 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:36.067445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:36.067867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:36.204436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:36.212318 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a4ceb776-47a8-47d1-84ef-5a0a836fd88a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.158062 Aug 26 12:24:36.212876 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 475/948] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:36 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:37.234455 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:37.235064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:37.241400 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:37.241873 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:37.242296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:37.242971 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:37.243447 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:37.243860 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:37.373143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:37.380816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-036244c7-3f80-4507-b551-f5b104ef22e0 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.151043 Aug 26 12:24:37.381375 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 474/949] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:37 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:38.401795 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:38.402417 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:38.408894 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:38.409369 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:38.409797 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:38.410472 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:38.410916 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:38.411370 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:38.537532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:38.545999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d7e010f9-95c7-4a2b-8b69-9ec930946439 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.148114 Aug 26 12:24:38.546574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 476/950] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:38 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:39.567341 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:39.567967 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:39.574236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:39.574710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:39.575138 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:39.575837 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:39.576855 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:39.577417 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:39.709397 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:39.717097 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3299e3f3-b86f-438d-b454-2ffd29219851 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.153536 Aug 26 12:24:39.717657 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 475/951] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:39 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:40.738061 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:40.738789 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:40.746482 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:40.746978 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:40.747455 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:40.748251 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:40.748678 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:40.749103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:40.878001 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:40.885698 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-aed64133-e08b-4aeb-902d-944a0451d7c5 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.151788 Aug 26 12:24:40.886279 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 477/952] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:40 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:41.908155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:41.908769 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:41.915226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:41.915706 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:41.916136 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:41.916819 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:41.917268 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:41.917686 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:42.049157 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:42.057392 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-591d6e8e-6ff2-4bb1-a359-84a13a791701 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.153235 Aug 26 12:24:42.057985 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 476/953] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:41 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:43.079956 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:43.080604 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:43.087027 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:43.087547 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:43.087984 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:43.088675 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:43.089158 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:43.089581 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:43.221642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:43.229307 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bc2e1ca9-ef07-4cfa-af6e-7f5dba36f7eb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.154044 Aug 26 12:24:43.229871 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 478/954] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:43 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:44.250674 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:44.251323 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:44.257826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:44.258312 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:44.258748 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:44.259470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:44.259918 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:44.260343 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:44.467087 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:44.474819 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bddfbd52-012d-48a3-a268-f24d3f124dcb tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.228048 Aug 26 12:24:44.475483 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 477/955] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:44 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:24:45.496750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:45.497377 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:45.504489 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:45.504973 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:45.505407 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:45.506090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:45.506541 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:45.506960 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:45.639150 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:45.646750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-16551630-8d3e-49d1-b917-97a7eb354d9b tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.153909 Aug 26 12:24:45.647358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 479/956] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:45 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:46.667547 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:46.667941 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:46.674605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:46.675123 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:46.675587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:46.676285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:46.676735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:46.677155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:46.811029 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:46.818824 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7343c288-b565-4896-ac4e-1a1eb89e03d3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1569 microversion: 2.1 time: 0.155460 Aug 26 12:24:46.819411 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 478/957] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:46 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:46.839177 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:24:46.839794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:46.846914 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:46.847433 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:46.847871 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:46.848563 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:46.849016 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:46.849436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:46.934680 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120696) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 26 12:24:47.005614 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f315739c-44dd-4224-8da1-f98b37caab1f tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "POST /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7/action" status: 202 len: 0 microversion: 2.1 time: 0.170078 Aug 26 12:24:47.006149 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 480/958] 10.222.0.61 () {60 vars in 1278 bytes} [Fri Aug 26 12:24:46 2022] POST /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:24:47.015414 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:47.016108 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:47.023338 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:47.023887 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:47.024587 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:47.025322 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:47.025952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:47.026584 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:47.218251 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:47.225940 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23b98b0e-6f72-4ec7-a1e0-64c82f80dd93 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1517 microversion: 2.1 time: 0.215342 Aug 26 12:24:47.226454 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 479/959] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:47 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:48.247949 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:48.248638 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:48.256167 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:48.256910 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:48.257343 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:48.258040 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:48.258492 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:48.258913 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:48.391513 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:48.399242 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-218c7d8c-78bb-4a70-a8c0-d497c3842e77 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1575 microversion: 2.1 time: 0.155370 Aug 26 12:24:48.399811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 481/960] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:48 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:49.421665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:49.422267 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:49.428622 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:49.429106 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:49.429538 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:49.430219 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:49.430667 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:49.431091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:49.563902 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:49.571666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01603c36-f142-4bc0-8735-c45a0b30785d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1575 microversion: 2.1 time: 0.154567 Aug 26 12:24:49.572239 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 480/961] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:49 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:50.185883 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:50.188103 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:50.194351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.194829 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.195283 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.195966 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.196408 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.196822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.225987 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ff5dd357-1f1d-426f-b7de-4539bbd9212a tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044513 Aug 26 12:24:50.226552 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 482/962] 10.222.0.61 () {60 vars in 1343 bytes} [Fri Aug 26 12:24:50 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:50.289444 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:50.289938 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:50.295963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.296446 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.296877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.297563 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.298011 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.298427 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.323284 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:24:50.396786 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07b35a77-f77e-4921-875a-160385dfa433 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 204 len: 0 microversion: 2.20 time: 0.110946 Aug 26 12:24:50.397436 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 481/963] 10.222.0.61 () {60 vars in 1280 bytes} [Fri Aug 26 12:24:50 2022] DELETE /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 26 12:24:50.406043 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:50.406651 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:50.412571 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.413053 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.413483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.414166 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.414615 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.415040 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.586467 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:50.593154 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:50.593863 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:50.595761 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:50.597219 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:50.598577 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b83722f9-ea7a-4430-b6a1-dd2be03bf356 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.196507 Aug 26 12:24:50.611250 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 483/964] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:50 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:50.611460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.611460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.611460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.611460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.611791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.611791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.649952 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8798cbce-ddaa-4411-ac8f-277df5296db9 req-98a8d7b4-19a1-4c3e-b32d-2a7a2d119de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc520f61-d2b7-4697-afff-790f21c0cfb7", "name": "network-vif-unplugged", "status": "completed", "tag": "bdb36592-a3cb-4c92-ba6b-c550ed44b5ab"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:24:50.660838 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8798cbce-ddaa-4411-ac8f-277df5296db9 req-98a8d7b4-19a1-4c3e-b32d-2a7a2d119de6 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:50.661311 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8798cbce-ddaa-4411-ac8f-277df5296db9 req-98a8d7b4-19a1-4c3e-b32d-2a7a2d119de6 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:50.662189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8798cbce-ddaa-4411-ac8f-277df5296db9 req-98a8d7b4-19a1-4c3e-b32d-2a7a2d119de6 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:50.677075 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8798cbce-ddaa-4411-ac8f-277df5296db9 req-98a8d7b4-19a1-4c3e-b32d-2a7a2d119de6 service nova] Creating event network-vif-unplugged:bdb36592-a3cb-4c92-ba6b-c550ed44b5ab for instance dc520f61-d2b7-4697-afff-790f21c0cfb7 on hv-cinder-84630 Aug 26 12:24:50.682050 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8798cbce-ddaa-4411-ac8f-277df5296db9 req-98a8d7b4-19a1-4c3e-b32d-2a7a2d119de6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035777 Aug 26 12:24:50.683101 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 484/965] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:24:50.745256 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:50.756561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e682d27-b49a-4682-970b-2046a3600aa2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1575 microversion: 2.1 time: 0.167416 Aug 26 12:24:50.757143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 482/966] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:50 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:24:51.624354 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:51.625049 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:51.631183 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:51.631695 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:51.632145 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:51.632815 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:51.633264 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:51.633686 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:51.760276 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:51.768313 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:51.769753 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:51.770896 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-90bffca3-2b83-4e44-b794-c8c1f01678a7 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1722 microversion: 2.20 time: 0.151386 Aug 26 12:24:51.771512 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 485/967] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:51 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:51.778171 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:51.779329 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:51.785806 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:51.786286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:51.786722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:51.787442 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:51.787903 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:51.788327 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:51.916834 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:51.924876 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13231f45-dd9c-488d-b920-b08e83834ed3 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1575 microversion: 2.1 time: 0.150602 Aug 26 12:24:51.925480 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 483/968] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:51 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:52.794171 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:52.795266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:52.801972 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:52.802465 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:52.802899 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:52.803642 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:52.804098 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:52.804684 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:52.945963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:52.947240 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:52.954365 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:52.954953 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:52.955570 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:52.956551 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:52.957079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:52.957568 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:52.987813 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:52.997234 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:52.999597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0e013faf32b84179989eb99be958555f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4583d65a595463b97e8dfabbf3da521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:53.001844 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-34f5971e-da33-456f-8024-2331b9f6a8e2 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 200 len: 1654 microversion: 2.20 time: 0.211486 Aug 26 12:24:53.002332 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 486/969] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:52 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 1654 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 26 12:24:53.156627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:53.156842 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d74d253f-91c5-4c68-8242-0a93f322d7c9 req-15f2d9d7-dfe6-4818-9d73-b9cdd202d6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d12d93c-1a7e-4c71-a2b0-c380b5d706e9", "name": "network-vif-deleted", "tag": "717a8a96-49f7-4b89-98a4-3ef8aa78066c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:24:53.161609 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:24:53.168190 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d74d253f-91c5-4c68-8242-0a93f322d7c9 req-15f2d9d7-dfe6-4818-9d73-b9cdd202d6f1 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:53.168888 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d74d253f-91c5-4c68-8242-0a93f322d7c9 req-15f2d9d7-dfe6-4818-9d73-b9cdd202d6f1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:53.169028 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e23c9373-17a2-425b-9d46-2971f7bcad71 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1575 microversion: 2.1 time: 0.226359 Aug 26 12:24:53.170351 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d74d253f-91c5-4c68-8242-0a93f322d7c9 req-15f2d9d7-dfe6-4818-9d73-b9cdd202d6f1 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:53.171376 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 484/970] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:52 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:24:53.191634 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d74d253f-91c5-4c68-8242-0a93f322d7c9 req-15f2d9d7-dfe6-4818-9d73-b9cdd202d6f1 service nova] Creating event network-vif-deleted:717a8a96-49f7-4b89-98a4-3ef8aa78066c for instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 on hv-cinder-84630 Aug 26 12:24:53.198213 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-d74d253f-91c5-4c68-8242-0a93f322d7c9 req-15f2d9d7-dfe6-4818-9d73-b9cdd202d6f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117717 Aug 26 12:24:53.198822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 487/971] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:24:54.024460 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:54.025067 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:54.033666 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:54.034189 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:54.034888 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:54.035735 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:54.036191 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:54.036632 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:54.052356 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] HTTP exception thrown: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Request method failure captured: Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 HTTP/1.1 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLpm5tL1mN-57rNajcF6d3ur8vWaaj-wmuS5qsYnK7EkS0nsswm-SaB0Pya0aQTDsDsAIR5rnSCCBiyNaxfBQSKLaWDN2RvKneFtsbwJlngHtThGUmm2Kxq1LhehpukGf1QPIfz_AQPmgHUF2KLfKKJeKlC0Ftdkh3TOYCwiOvjlbr0 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:24:54.054009 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4583d65a595463b97e8dfabbf3da521", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 0e013faf32b84179989eb99be958555f Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:54.055654 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '8d12d93c-1a7e-4c71-a2b0-c380b5d706e9'} Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:24:54.056544 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:54.058179 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:54.059816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Returning 404 to user: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:24:54.059816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39ba1407-0bc1-4985-afe7-fccae93eb889 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 404 len: 111 microversion: 2.20 time: 0.034856 Aug 26 12:24:54.059816 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 485/972] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:54 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:24:54.065478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-947d1d0d-623d-4447-befb-3974fb3426ad tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '.version_select at 0x7ffa9b0e04c0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:54.086514 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-947d1d0d-623d-4447-befb-3974fb3426ad tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114687597" status: 204 len: 0 microversion: 2.20 time: 0.025424 Aug 26 12:24:54.091867 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 488/973] 10.222.0.61 () {60 vars in 1262 bytes} [Fri Aug 26 12:24:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114687597 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 26 12:24:54.191826 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:54.192436 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:54.199513 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:54.200254 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:54.201361 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:54.202237 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:54.202850 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:54.203451 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:54.370211 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:54.378609 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89b06968-215b-442c-95e0-0e21a9e2c7a7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1575 microversion: 2.1 time: 0.190940 Aug 26 12:24:54.379428 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 486/974] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:54 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:55.399405 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:55.400135 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:55.407682 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:55.408157 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:55.408585 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:55.409258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:55.409705 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:55.410121 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:55.540561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:55.549493 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-347999ea-5404-4fe9-a581-bb014677a431 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1575 microversion: 2.1 time: 0.153973 Aug 26 12:24:55.550062 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 489/975] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:55 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:55.852687 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:55.853200 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:55.859779 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:55.860262 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:55.860694 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:55.861632 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:55.862083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:55.862500 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:55.875561 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] HTTP exception thrown: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Request method failure captured: Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 HTTP/1.1 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLpm5tL1mN-57rNajcF6d3ur8vWaaj-wmuS5qsYnK7EkS0nsswm-SaB0Pya0aQTDsDsAIR5rnSCCBiyNaxfBQSKLaWDN2RvKneFtsbwJlngHtThGUmm2Kxq1LhehpukGf1QPIfz_AQPmgHUF2KLfKKJeKlC0Ftdkh3TOYCwiOvjlbr0 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:24:55.877104 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4583d65a595463b97e8dfabbf3da521", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 0e013faf32b84179989eb99be958555f Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.878791 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': '8d12d93c-1a7e-4c71-a2b0-c380b5d706e9'} Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:24:55.879722 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.881193 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.882752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Returning 404 to user: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:24:55.882752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7870aa4d-fd8c-46ac-8ee6-9dd6fecfbcd6 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 404 len: 111 microversion: 2.20 time: 0.029678 Aug 26 12:24:55.882752 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 487/976] 10.222.0.61 () {60 vars in 1280 bytes} [Fri Aug 26 12:24:55 2022] DELETE /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:24:55.886855 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:55.887511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:55.893934 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:55.894419 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:55.894858 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:55.895582 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:55.896042 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:55.896471 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:55.910285 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] HTTP exception thrown: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Request method failure captured: Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 HTTP/1.1 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLpm5tL1mN-57rNajcF6d3ur8vWaaj-wmuS5qsYnK7EkS0nsswm-SaB0Pya0aQTDsDsAIR5rnSCCBiyNaxfBQSKLaWDN2RvKneFtsbwJlngHtThGUmm2Kxq1LhehpukGf1QPIfz_AQPmgHUF2KLfKKJeKlC0Ftdkh3TOYCwiOvjlbr0 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:24:55.911925 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4583d65a595463b97e8dfabbf3da521", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 0e013faf32b84179989eb99be958555f Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.913460 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '8d12d93c-1a7e-4c71-a2b0-c380b5d706e9'} Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:24:55.914244 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. Aug 26 12:24:55.915592 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:55.917216 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Returning 404 to user: Instance 8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:24:55.917216 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5e1fe5b0-acfa-41a3-b2de-1717096b8794 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9" status: 404 len: 111 microversion: 2.20 time: 0.030282 Aug 26 12:24:55.917216 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 490/977] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:55 2022] GET /compute/v2.1/servers/8d12d93c-1a7e-4c71-a2b0-c380b5d706e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:24:56.571441 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:56.571965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:56.579548 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:56.580074 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:56.580665 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:56.581222 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:56.581710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:56.582143 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:56.721796 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:24:56.729590 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-688d4b8b-9fb9-4f6a-af80-400b34dbbbe7 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1562 microversion: 2.1 time: 0.163078 Aug 26 12:24:56.730150 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 488/978] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:24:56 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:24:57.051930 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:57.052498 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:57.059355 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:57.059836 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:57.060269 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:57.060962 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:57.061999 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:57.062445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:57.075760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] HTTP exception thrown: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Request method failure captured: Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd HTTP/1.1 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLpm5tL1mN-57rNajcF6d3ur8vWaaj-wmuS5qsYnK7EkS0nsswm-SaB0Pya0aQTDsDsAIR5rnSCCBiyNaxfBQSKLaWDN2RvKneFtsbwJlngHtThGUmm2Kxq1LhehpukGf1QPIfz_AQPmgHUF2KLfKKJeKlC0Ftdkh3TOYCwiOvjlbr0 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:24:57.077326 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4583d65a595463b97e8dfabbf3da521", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 0e013faf32b84179989eb99be958555f Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.079036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': 'f79b22dd-76aa-4cd2-814b-5d61b81a73bd'} Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:24:57.080090 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.081478 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.082771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Returning 404 to user: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:24:57.082771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3ed22f72-d402-4ea1-a47f-84ebf322abd1 tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 404 len: 111 microversion: 2.20 time: 0.030832 Aug 26 12:24:57.082771 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 491/979] 10.222.0.61 () {60 vars in 1280 bytes} [Fri Aug 26 12:24:57 2022] DELETE /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:24:57.087575 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:24:57.088123 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] [instance: f79b22dd-76aa-4cd2-814b-5d61b81a73bd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:24:57.094406 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:57.094877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:57.095380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:57.096064 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:57.096514 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:57.096926 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:57.110990 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] HTTP exception thrown: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Request method failure captured: Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd HTTP/1.1 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLpm5tL1mN-57rNajcF6d3ur8vWaaj-wmuS5qsYnK7EkS0nsswm-SaB0Pya0aQTDsDsAIR5rnSCCBiyNaxfBQSKLaWDN2RvKneFtsbwJlngHtThGUmm2Kxq1LhehpukGf1QPIfz_AQPmgHUF2KLfKKJeKlC0Ftdkh3TOYCwiOvjlbr0 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:24:57.112601 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f4583d65a595463b97e8dfabbf3da521", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f4583d65a595463b97e8dfabbf3da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: f4583d65a595463b97e8dfabbf3da521 Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2131792260 Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: 0e013faf32b84179989eb99be958555f Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2131792260-project Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.114450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'f79b22dd-76aa-4cd2-814b-5d61b81a73bd'} Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:24:57.115319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. Aug 26 12:24:57.116595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:24:57.117802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] Returning 404 to user: Instance f79b22dd-76aa-4cd2-814b-5d61b81a73bd could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:24:57.117802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23369778-715b-4650-bb42-e093ffc7359f tempest-AttachVolumeShelveTestJSON-2131792260 tempest-AttachVolumeShelveTestJSON-2131792260-project] 10.222.0.61 "GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd" status: 404 len: 111 microversion: 2.20 time: 0.030463 Aug 26 12:24:57.117802 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 489/980] 10.222.0.61 () {60 vars in 1277 bytes} [Fri Aug 26 12:24:57 2022] GET /compute/v2.1/servers/f79b22dd-76aa-4cd2-814b-5d61b81a73bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 26 12:24:58.744436 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-cfeb7e20-e0af-43d7-afff-c0097819d8b1 req-2611bd07-4c8a-4247-a34b-27a2b9303f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc520f61-d2b7-4697-afff-790f21c0cfb7", "name": "network-vif-plugged", "status": "completed", "tag": "bdb36592-a3cb-4c92-ba6b-c550ed44b5ab"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:24:58.756893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-cfeb7e20-e0af-43d7-afff-c0097819d8b1 req-2611bd07-4c8a-4247-a34b-27a2b9303f35 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:24:58.757446 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-cfeb7e20-e0af-43d7-afff-c0097819d8b1 req-2611bd07-4c8a-4247-a34b-27a2b9303f35 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:24:58.758189 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-cfeb7e20-e0af-43d7-afff-c0097819d8b1 req-2611bd07-4c8a-4247-a34b-27a2b9303f35 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:24:58.769733 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-cfeb7e20-e0af-43d7-afff-c0097819d8b1 req-2611bd07-4c8a-4247-a34b-27a2b9303f35 service nova] Creating event network-vif-plugged:bdb36592-a3cb-4c92-ba6b-c550ed44b5ab for instance dc520f61-d2b7-4697-afff-790f21c0cfb7 on hv-cinder-84630 Aug 26 12:24:58.775064 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-cfeb7e20-e0af-43d7-afff-c0097819d8b1 req-2611bd07-4c8a-4247-a34b-27a2b9303f35 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039822 Aug 26 12:24:58.775688 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 492/981] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:25:59.354841 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:25:59.355710 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=18 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:25:59.360743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-544496289", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "networks": [{"uuid": "96a56268-0534-4093-baae-a7fd3b0478ce"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:25:59.415455 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] validate_networks() for [('96a56268-0534-4093-baae-a7fd3b0478ce', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:26:00.052756 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:26:00.053178 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:26:00.053646 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:26:00.054061 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:26:00.054469 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:26:00.064126 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:00.064618 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:00.065047 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:00.065798 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:00.066255 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:00.066701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:00.084274 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Getting quotas for project 9a6f1bf35060433bb91cdedf633ebcd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:26:00.088211 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Getting quotas for user b07c76d1e62a4f4290b276bc233d953c and project 9a6f1bf35060433bb91cdedf633ebcd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:26:00.098852 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:26:00.101138 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:26:00.146237 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e4f0a3a-39e4-4144-8500-bf2aa4bb5eb6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793097 Aug 26 12:26:00.146884 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 490/982] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:25:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 26 12:26:00.156155 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:00.157072 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:00.162637 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fd67a34e-b442-4f28-83e5-faa2d16aadde tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:00.163394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fd67a34e-b442-4f28-83e5-faa2d16aadde tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:00.226348 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fd67a34e-b442-4f28-83e5-faa2d16aadde tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:00.233204 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fd67a34e-b442-4f28-83e5-faa2d16aadde tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1213 microversion: 2.1 time: 0.079307 Aug 26 12:26:00.233756 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 493/983] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:00 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:01.255410 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:01.256734 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:01.263448 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:01.264135 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:01.264607 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:01.266391 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:01.267305 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:01.267988 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:01.350721 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:01.358300 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e32e61bb-3dd0-4e94-841a-ee30949640ba tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1283 microversion: 2.1 time: 0.108220 Aug 26 12:26:01.358878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 491/984] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:01 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:02.379516 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:02.380126 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:02.386563 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:02.387040 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:02.387492 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:02.388175 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:02.388623 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:02.389036 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:02.526033 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7f35b585-3dfa-4b76-80d9-ff2cbe4a956d req-4ed56def-66db-45e8-8669-c11d011613a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc348151-5562-4c55-9576-a751bb01a786", "tag": "f6d6e2c9-2a67-4fdf-83ab-96659962790e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:02.537764 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7f35b585-3dfa-4b76-80d9-ff2cbe4a956d req-4ed56def-66db-45e8-8669-c11d011613a4 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:02.538256 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7f35b585-3dfa-4b76-80d9-ff2cbe4a956d req-4ed56def-66db-45e8-8669-c11d011613a4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:02.538676 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7f35b585-3dfa-4b76-80d9-ff2cbe4a956d req-4ed56def-66db-45e8-8669-c11d011613a4 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:02.550188 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7f35b585-3dfa-4b76-80d9-ff2cbe4a956d req-4ed56def-66db-45e8-8669-c11d011613a4 service nova] Creating event network-changed:f6d6e2c9-2a67-4fdf-83ab-96659962790e for instance bc348151-5562-4c55-9576-a751bb01a786 on hv-cinder-84630 Aug 26 12:26:02.555045 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7f35b585-3dfa-4b76-80d9-ff2cbe4a956d req-4ed56def-66db-45e8-8669-c11d011613a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Aug 26 12:26:02.556094 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 492/985] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:26:02.612530 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:02.622068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cce4e06b-6ded-458e-b835-3936e992c8f5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1313 microversion: 2.1 time: 0.246357 Aug 26 12:26:02.622654 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 494/986] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:02 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:03.644109 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:03.644810 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:03.650948 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:03.651462 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:03.651894 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:03.652572 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:03.653024 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:03.653450 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:03.782187 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:03.789902 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d883397-6457-4752-bf5f-15163068514d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1313 microversion: 2.1 time: 0.150501 Aug 26 12:26:03.790470 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 493/987] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:03 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:04.809870 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:04.810484 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:04.817398 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:04.817988 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:04.818454 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:04.819222 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:04.819750 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:04.820334 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:04.951109 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:04.959443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-df65eb86-6b32-427e-b06a-392fe02539c8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1313 microversion: 2.1 time: 0.153439 Aug 26 12:26:04.960005 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 495/988] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:04 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:05.979684 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:05.980289 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:05.987652 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:05.988132 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:05.988569 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:05.989253 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:05.989705 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:05.990128 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:06.116384 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:06.124037 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a0a85d2-dc7d-4250-afed-9fdadd325c22 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1313 microversion: 2.1 time: 0.148210 Aug 26 12:26:06.124707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 494/989] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:05 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:07.145243 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:07.146069 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:07.152618 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:07.153095 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:07.153520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:07.154269 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:07.154708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:07.155123 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:07.198385 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3ad025b5-5c05-450a-97cc-2f622debc755 req-eddb9b03-473c-4c17-9b43-d3214071cb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc348151-5562-4c55-9576-a751bb01a786", "name": "network-vif-plugged", "status": "completed", "tag": "f6d6e2c9-2a67-4fdf-83ab-96659962790e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:07.208597 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ad025b5-5c05-450a-97cc-2f622debc755 req-eddb9b03-473c-4c17-9b43-d3214071cb9e service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:07.209094 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ad025b5-5c05-450a-97cc-2f622debc755 req-eddb9b03-473c-4c17-9b43-d3214071cb9e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:07.209516 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ad025b5-5c05-450a-97cc-2f622debc755 req-eddb9b03-473c-4c17-9b43-d3214071cb9e service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:07.220274 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3ad025b5-5c05-450a-97cc-2f622debc755 req-eddb9b03-473c-4c17-9b43-d3214071cb9e service nova] Creating event network-vif-plugged:f6d6e2c9-2a67-4fdf-83ab-96659962790e for instance bc348151-5562-4c55-9576-a751bb01a786 on hv-cinder-84630 Aug 26 12:26:07.225336 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3ad025b5-5c05-450a-97cc-2f622debc755 req-eddb9b03-473c-4c17-9b43-d3214071cb9e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154254 Aug 26 12:26:07.225924 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 496/990] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:26:07.290145 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:07.298181 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ee6a576-abd7-44bf-be0f-aef6c7c36d23 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1313 microversion: 2.1 time: 0.157567 Aug 26 12:26:07.298783 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 495/991] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:07 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:08.320496 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:08.321188 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:08.327254 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:08.327922 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:08.328157 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:08.329337 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:08.329785 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:08.330205 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:08.461507 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:08.469358 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b8156b14-8f2c-46ce-a4c3-a1ca0d192465 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1313 microversion: 2.1 time: 0.153581 Aug 26 12:26:08.470599 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 497/992] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:08 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:09.490708 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:09.491346 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:09.497835 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:09.498319 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:09.498935 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:09.499674 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:09.500297 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:09.500785 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:09.630963 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:09.638644 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94c5c207-7d01-41e0-8f30-a55bbf0c0786 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1497 microversion: 2.1 time: 0.151807 Aug 26 12:26:09.639226 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 496/993] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:09 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:26:10.038134 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:10.038647 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:10.044991 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:10.045474 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:10.045907 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:10.046598 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:10.047054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:10.047564 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:10.072412 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:26:10.147316 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8f13f8d3-b958-4bdb-aeb7-26aa2a951cac tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 204 len: 0 microversion: 2.1 time: 0.112643 Aug 26 12:26:10.147902 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 498/994] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:26:10 2022] DELETE /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:26:10.156221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:10.156831 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:10.158839 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:10.159581 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:10.165286 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:10.165766 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:10.166197 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:10.166883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:10.167358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:10.167781 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:10.295652 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:10.303693 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f4a8e71-b8c2-4583-9a7e-157cb6f761be tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1503 microversion: 2.1 time: 0.151494 Aug 26 12:26:10.304294 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 497/995] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:10 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:11.325561 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:11.326302 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:11.328289 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:11.334760 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:11.335268 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:11.335735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:11.336434 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:11.336887 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:11.337310 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:11.469204 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:11.477864 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5f928b8e-f88c-4f03-b67b-255292f49986 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1503 microversion: 2.1 time: 0.156587 Aug 26 12:26:11.478445 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 499/996] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:11 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:12.030968 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6a8e051d-82fd-4bc6-a016-6cc9bd7f9d61 req-b8d6d1a9-8a89-4956-a4e1-2e95da7477fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc348151-5562-4c55-9576-a751bb01a786", "name": "network-vif-deleted", "tag": "f6d6e2c9-2a67-4fdf-83ab-96659962790e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:12.043105 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6a8e051d-82fd-4bc6-a016-6cc9bd7f9d61 req-b8d6d1a9-8a89-4956-a4e1-2e95da7477fd service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:12.043618 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6a8e051d-82fd-4bc6-a016-6cc9bd7f9d61 req-b8d6d1a9-8a89-4956-a4e1-2e95da7477fd service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:12.044089 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6a8e051d-82fd-4bc6-a016-6cc9bd7f9d61 req-b8d6d1a9-8a89-4956-a4e1-2e95da7477fd service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:12.056874 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6a8e051d-82fd-4bc6-a016-6cc9bd7f9d61 req-b8d6d1a9-8a89-4956-a4e1-2e95da7477fd service nova] Creating event network-vif-deleted:f6d6e2c9-2a67-4fdf-83ab-96659962790e for instance bc348151-5562-4c55-9576-a751bb01a786 on hv-cinder-84630 Aug 26 12:26:12.062380 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6a8e051d-82fd-4bc6-a016-6cc9bd7f9d61 req-b8d6d1a9-8a89-4956-a4e1-2e95da7477fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035080 Aug 26 12:26:12.063221 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 498/997] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:26:12.498185 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:12.498813 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:12.505816 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:12.506471 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:12.507066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:12.507990 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:12.508447 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:12.508871 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:12.542240 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:12.542634 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:12.543066 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:12.543555 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lazy-loading 'fault' on Instance uuid bc348151-5562-4c55-9576-a751bb01a786 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:26:12.590241 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:12.599532 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1f7c4aae-091c-4344-bb39-56eb452dfee6 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 200 len: 1303 microversion: 2.1 time: 0.105227 Aug 26 12:26:12.600044 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 500/998] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:12 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:13.624253 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:13.624952 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: bc348151-5562-4c55-9576-a751bb01a786] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:13.631433 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:13.631916 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:13.632351 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:13.633036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:13.633486 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:13.633908 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:13.647419 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] HTTP exception thrown: Instance bc348151-5562-4c55-9576-a751bb01a786 could not be found. Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Request method failure captured: Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 HTTP/1.1 Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept: application/json Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Connection: close Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Length: 0 Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Content-Type: application/json Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.11 Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjCLvVA8hBC2tNDDGFt3fUIsC5Ym0LG1yQYJdkdKU5csCRuAgr-BcVZPFNanhX03PCu9Bskm0bOSt__5ZHg1kTYTcVkJ1KqbYsmn14uXhM1_B3K2jrfDMGfeCLf8c98uGzyg0tKVQdgKFbJlLWIQNRRtIyjTW7yaNRBBosKYU16LURM-M Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Id: 9a6f1bf35060433bb91cdedf633ebcd8 Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesActionsTest-236123186 Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Role: member,reader Aug 26 12:26:13.649016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a6f1bf35060433bb91cdedf633ebcd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a6f1bf35060433bb91cdedf633ebcd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a6f1bf35060433bb91cdedf633ebcd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a6f1bf35060433bb91cdedf633ebcd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesActionsTest-236123186 Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9a6f1bf35060433bb91cdedf633ebcd8 Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesActionsTest-236123186 Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesActionsTest-236123186-project Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Id: b07c76d1e62a4f4290b276bc233d953c Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesActionsTest-236123186-project Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: method: > Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: exception: Instance bc348151-5562-4c55-9576-a751bb01a786 could not be found. Aug 26 12:26:13.650765 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: action_args: {'id': 'bc348151-5562-4c55-9576-a751bb01a786'} Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc348151-5562-4c55-9576-a751bb01a786 could not be found. Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:26:13.651992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc348151-5562-4c55-9576-a751bb01a786 could not be found. Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc348151-5562-4c55-9576-a751bb01a786 could not be found. Aug 26 12:26:13.653638 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Aug 26 12:26:13.655077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Returning 404 to user: Instance bc348151-5562-4c55-9576-a751bb01a786 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:26:13.655077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-85bfcc0e-59df-480c-b200-e24a769cf6ce tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786" status: 404 len: 111 microversion: 2.1 time: 0.031347 Aug 26 12:26:13.655077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 499/999] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:13 2022] GET /compute/v2.1/servers/bc348151-5562-4c55-9576-a751bb01a786 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:26:13.698515 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-976196053", "imageRef": "d4264dd7-e056-4459-8e90-1fbd4f650ecf", "flavorRef": "452", "networks": [{"uuid": "96a56268-0534-4093-baae-a7fd3b0478ce"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:13.751834 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] validate_networks() for [('96a56268-0534-4093-baae-a7fd3b0478ce', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 26 12:26:14.097363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 26 12:26:14.097787 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 26 12:26:14.098257 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 26 12:26:14.098663 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 26 12:26:14.099071 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 26 12:26:14.107687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:14.108168 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:14.108596 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:14.109323 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:14.110086 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:14.110517 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:14.127187 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Getting quotas for project 9a6f1bf35060433bb91cdedf633ebcd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 26 12:26:14.131092 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Getting quotas for user b07c76d1e62a4f4290b276bc233d953c and project 9a6f1bf35060433bb91cdedf633ebcd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 26 12:26:14.142546 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 26 12:26:14.144822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4264dd7-e056-4459-8e90-1fbd4f650ecf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 26 12:26:14.190613 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0998d182-b861-41f0-8a8d-a212071c7c73 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495826 Aug 26 12:26:14.191185 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 501/1000] 10.222.0.61 () {60 vars in 1147 bytes} [Fri Aug 26 12:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 26 12:26:14.201743 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65bd05d8-ab05-4c94-b328-6afcaab3f712 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:14.202462 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65bd05d8-ab05-4c94-b328-6afcaab3f712 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:14.261631 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-65bd05d8-ab05-4c94-b328-6afcaab3f712 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:14.269517 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65bd05d8-ab05-4c94-b328-6afcaab3f712 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1213 microversion: 2.1 time: 0.071648 Aug 26 12:26:14.270091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 500/1001] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:14 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:15.289814 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:15.291341 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:15.300277 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:15.300839 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:15.301279 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:15.302019 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:15.302476 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:15.303068 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:15.376951 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:15.384884 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2849d29f-fafa-4fee-b45f-be9a4770ebf7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1273 microversion: 2.1 time: 0.099122 Aug 26 12:26:15.385687 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 502/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:15 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:16.405878 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:16.407307 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:16.415125 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:16.415770 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:16.416214 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:16.417052 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:16.417510 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:16.418154 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:16.604936 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0ca8465d-86eb-4b13-a05f-d20b5f439bab req-f42ea6b9-3105-4690-b91b-d0d30fbf9234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1359e89d-5296-44b6-98c8-0c50b440c7f6", "tag": "8e947449-fa91-4a98-a31c-48bf3496a9e1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:16.617976 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0ca8465d-86eb-4b13-a05f-d20b5f439bab req-f42ea6b9-3105-4690-b91b-d0d30fbf9234 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:16.618735 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0ca8465d-86eb-4b13-a05f-d20b5f439bab req-f42ea6b9-3105-4690-b91b-d0d30fbf9234 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:16.619600 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0ca8465d-86eb-4b13-a05f-d20b5f439bab req-f42ea6b9-3105-4690-b91b-d0d30fbf9234 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:16.636224 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0ca8465d-86eb-4b13-a05f-d20b5f439bab req-f42ea6b9-3105-4690-b91b-d0d30fbf9234 service nova] Creating event network-changed:8e947449-fa91-4a98-a31c-48bf3496a9e1 for instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 on hv-cinder-84630 Aug 26 12:26:16.642156 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0ca8465d-86eb-4b13-a05f-d20b5f439bab req-f42ea6b9-3105-4690-b91b-d0d30fbf9234 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040704 Aug 26 12:26:16.643494 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 503/1003] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 26 12:26:16.643899 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:16.662164 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f7a81d2-d53e-460b-bc0d-49f9c13a24d5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.257518 Aug 26 12:26:16.679358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 501/1004] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:16 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:16.687026 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:16.689822 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:16.698639 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:16.699196 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:16.699736 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:16.700442 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:16.700893 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:16.701317 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:16.731100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:26:16.762728 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3b0235fb-cba2-48c0-b94f-16ea7f12616f req-8f3efcfe-02a5-41b9-8023-2315f6f96f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc520f61-d2b7-4697-afff-790f21c0cfb7", "tag": "bdb36592-a3cb-4c92-ba6b-c550ed44b5ab"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:16.775463 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3b0235fb-cba2-48c0-b94f-16ea7f12616f req-8f3efcfe-02a5-41b9-8023-2315f6f96f75 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:16.776396 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3b0235fb-cba2-48c0-b94f-16ea7f12616f req-8f3efcfe-02a5-41b9-8023-2315f6f96f75 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:16.777079 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3b0235fb-cba2-48c0-b94f-16ea7f12616f req-8f3efcfe-02a5-41b9-8023-2315f6f96f75 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:16.790518 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3b0235fb-cba2-48c0-b94f-16ea7f12616f req-8f3efcfe-02a5-41b9-8023-2315f6f96f75 service nova] Creating event network-changed:bdb36592-a3cb-4c92-ba6b-c550ed44b5ab for instance dc520f61-d2b7-4697-afff-790f21c0cfb7 on hv-cinder-84630 Aug 26 12:26:16.796367 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3b0235fb-cba2-48c0-b94f-16ea7f12616f req-8f3efcfe-02a5-41b9-8023-2315f6f96f75 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115492 Aug 26 12:26:16.798296 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 502/1005] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:26:17.001511 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-afa3708d-c303-46de-880e-5373b0586d2a tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 204 len: 0 microversion: 2.1 time: 0.320704 Aug 26 12:26:17.003872 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 504/1006] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:26:16 2022] DELETE /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:26:17.013763 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:17.014758 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:17.025822 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:17.026605 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:17.027416 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:17.028333 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:17.028787 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:17.029496 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:17.209468 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:17.217805 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4128b6cd-365b-49af-8e37-2350272c6892 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.209602 Aug 26 12:26:17.218616 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 503/1007] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:17 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:26:17.683443 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:17.684240 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:17.691833 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:17.692666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:17.693117 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:17.693811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:17.694258 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:17.694817 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:17.833108 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:17.841136 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9a01ec96-a411-460f-9517-a5784fbd5018 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.161938 Aug 26 12:26:17.841689 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 505/1008] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:17 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:18.240546 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:18.241165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:18.247664 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:18.248165 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:18.248729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:18.249430 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:18.249883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:18.250304 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:18.384233 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:18.392389 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7378866-3de6-4e62-95b7-3e9a3684e1cd tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.156611 Aug 26 12:26:18.392951 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 504/1009] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:18 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:18.862567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:18.863164 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:18.869585 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:18.870059 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:18.870483 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:18.871161 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:18.871632 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:18.872046 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:19.001911 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:19.009378 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e330e1df-0f83-4cac-9cb6-442fe34ddba5 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.151025 Aug 26 12:26:19.009935 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 506/1010] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:18 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:19.413155 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:19.413761 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:19.420302 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:19.420775 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:19.421202 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:19.421877 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:19.422481 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:19.423077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:19.587091 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:19.595140 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4bfccaf7-439e-485e-8799-87fe82cf5e6d tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1568 microversion: 2.1 time: 0.185651 Aug 26 12:26:19.595729 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 505/1011] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:19 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:20.029784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:20.030390 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:20.037327 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:20.037807 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:20.038235 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:20.038920 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:20.039394 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:20.039811 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:20.245682 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:20.253565 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c00efbe-1d62-4974-9b8f-2372666783d8 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.227625 Aug 26 12:26:20.254350 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 507/1012] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:20 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:20.560453 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-97164901-59cf-4175-807e-889749d7c4de req-a77331e4-d31b-4bea-80ff-338557ee5657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc520f61-d2b7-4697-afff-790f21c0cfb7", "name": "network-vif-deleted", "tag": "bdb36592-a3cb-4c92-ba6b-c550ed44b5ab"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:20.573130 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-97164901-59cf-4175-807e-889749d7c4de req-a77331e4-d31b-4bea-80ff-338557ee5657 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:20.573700 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-97164901-59cf-4175-807e-889749d7c4de req-a77331e4-d31b-4bea-80ff-338557ee5657 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:20.574128 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-97164901-59cf-4175-807e-889749d7c4de req-a77331e4-d31b-4bea-80ff-338557ee5657 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:20.595904 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-97164901-59cf-4175-807e-889749d7c4de req-a77331e4-d31b-4bea-80ff-338557ee5657 service nova] Creating event network-vif-deleted:bdb36592-a3cb-4c92-ba6b-c550ed44b5ab for instance dc520f61-d2b7-4697-afff-790f21c0cfb7 on hv-cinder-84630 Aug 26 12:26:20.601488 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-97164901-59cf-4175-807e-889749d7c4de req-a77331e4-d31b-4bea-80ff-338557ee5657 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044765 Aug 26 12:26:20.602092 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 506/1013] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:26:20.615945 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:20.616579 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:20.623042 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:20.623572 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:20.624009 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:20.624727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:20.625181 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:20.626137 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:20.730606 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e949eeed6cd451d8dc5d0877963b260', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f885c9fd8f394c999eee70e8d27180e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:20.734194 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:20.739570 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4f1fc0e3-ce2d-4900-8995-9a6cd437c486 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 200 len: 1220 microversion: 2.1 time: 0.127586 Aug 26 12:26:20.740154 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 508/1014] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:20 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:21.274908 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:21.275637 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:21.282585 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:21.283065 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:21.283529 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:21.284218 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:21.284736 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:21.285216 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:21.423046 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:21.431083 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4717256-8ef3-46a8-8130-b699254bb467 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.160370 Aug 26 12:26:21.431799 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 507/1015] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:21 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:21.760446 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:21.761073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] [instance: dc520f61-d2b7-4697-afff-790f21c0cfb7] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:21.768225 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:21.768710 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:21.769147 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:21.769840 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:21.770350 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:21.770776 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:21.784488 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] HTTP exception thrown: Instance dc520f61-d2b7-4697-afff-790f21c0cfb7 could not be found. Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Request method failure captured: Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 HTTP/1.1 Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLrj-alFZst0E-TMaiFMlsfMYSJ1gPTk_8uX8jT_TwzeUbim9tDJUBbVlErjm7gAsLeBzM8Paoe00E5ypHtZT5YIFZlfZBGkraRcHAhVdfh47m3ulYl21z9Hfd9wKXcilM_YBxhZvSVSkQ05nuY24k7oXGt0n6xxsJrckdfCQWec0bc Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: f885c9fd8f394c999eee70e8d27180e0 Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestShelveInstance-1691290364 Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:26:21.786148 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f885c9fd8f394c999eee70e8d27180e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f885c9fd8f394c999eee70e8d27180e0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f885c9fd8f394c999eee70e8d27180e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f885c9fd8f394c999eee70e8d27180e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestShelveInstance-1691290364 Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: f885c9fd8f394c999eee70e8d27180e0 Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestShelveInstance-1691290364 Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-TestShelveInstance-1691290364-project Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: 4e949eeed6cd451d8dc5d0877963b260 Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestShelveInstance-1691290364-project Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance dc520f61-d2b7-4697-afff-790f21c0cfb7 could not be found. Aug 26 12:26:21.787841 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': 'dc520f61-d2b7-4697-afff-790f21c0cfb7'} Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc520f61-d2b7-4697-afff-790f21c0cfb7 could not be found. Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:26:21.788821 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc520f61-d2b7-4697-afff-790f21c0cfb7 could not be found. Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc520f61-d2b7-4697-afff-790f21c0cfb7 could not be found. Aug 26 12:26:21.790374 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:21.791784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Returning 404 to user: Instance dc520f61-d2b7-4697-afff-790f21c0cfb7 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:26:21.791784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9690067f-55ca-4c60-9521-d46b75496c01 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7" status: 404 len: 111 microversion: 2.1 time: 0.030990 Aug 26 12:26:21.791784 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 509/1016] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:21 2022] GET /compute/v2.1/servers/dc520f61-d2b7-4697-afff-790f21c0cfb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 26 12:26:21.950851 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25ff730d-5a54-4f93-ba26-ca6bb46c9ba2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] Calling method '.version_select at 0x7ffa978be040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:21.972739 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25ff730d-5a54-4f93-ba26-ca6bb46c9ba2 tempest-TestShelveInstance-1691290364 tempest-TestShelveInstance-1691290364-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1601804971" status: 202 len: 0 microversion: 2.1 time: 0.025912 Aug 26 12:26:21.973596 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 508/1017] 10.222.0.61 () {58 vars in 1254 bytes} [Fri Aug 26 12:26:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1601804971 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 26 12:26:22.453210 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:22.454346 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:22.460169 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:22.460656 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:22.461096 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:22.461796 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:22.462250 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:22.462675 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:22.677142 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:22.684702 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6c9f7a3b-07ec-4e80-94c1-38b33a78f93a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.235398 Aug 26 12:26:22.685256 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 510/1018] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:22 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:26:23.140635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-41ebf1a7-9436-4a33-ad08-b31c16e09656 req-beb88195-3c1c-414f-904d-2959184e3f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1359e89d-5296-44b6-98c8-0c50b440c7f6", "name": "network-vif-plugged", "status": "completed", "tag": "8e947449-fa91-4a98-a31c-48bf3496a9e1"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:23.151853 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-41ebf1a7-9436-4a33-ad08-b31c16e09656 req-beb88195-3c1c-414f-904d-2959184e3f66 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:23.152404 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-41ebf1a7-9436-4a33-ad08-b31c16e09656 req-beb88195-3c1c-414f-904d-2959184e3f66 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:23.152905 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-41ebf1a7-9436-4a33-ad08-b31c16e09656 req-beb88195-3c1c-414f-904d-2959184e3f66 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:23.164369 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-41ebf1a7-9436-4a33-ad08-b31c16e09656 req-beb88195-3c1c-414f-904d-2959184e3f66 service nova] Creating event network-vif-plugged:8e947449-fa91-4a98-a31c-48bf3496a9e1 for instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 on hv-cinder-84630 Aug 26 12:26:23.169325 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-41ebf1a7-9436-4a33-ad08-b31c16e09656 req-beb88195-3c1c-414f-904d-2959184e3f66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032943 Aug 26 12:26:23.170012 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 509/1019] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:26:23.705266 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:23.705891 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:23.712933 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:23.713666 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:23.714453 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:23.715158 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:23.715641 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:23.716231 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:23.854100 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:23.863089 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ced5bc1-346c-4b67-afc0-2befb6bbafe7 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.162002 Aug 26 12:26:23.863694 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 511/1020] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:23 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:26:24.881994 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:24.887817 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:24.888883 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:24.896129 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:24.897034 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:24.897685 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:24.903793 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:24.904474 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:24.905579 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:25.114047 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:25.121707 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-941162e0-10e6-4cdf-9a58-13bfa5a84bad tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1313 microversion: 2.1 time: 0.241067 Aug 26 12:26:25.122285 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 510/1021] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:24 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:26.142574 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:26.143178 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:26.145029 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:26.145825 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:26.152050 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:26.152479 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:26.152912 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:26.153606 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:26.154054 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:26.154476 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:26.670021 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:26.678548 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b3174f14-2124-476a-93c7-0e993e4cee3a tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1497 microversion: 2.1 time: 0.540514 Aug 26 12:26:26.679113 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 512/1022] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:26 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1497 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:27.181701 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:27.182965 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:27.190525 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:27.191383 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:27.191882 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:27.192650 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:27.193077 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:27.193741 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:27.221260 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 26 12:26:27.272677 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:27.313992 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d901ce8-6bf1-4fc6-a059-65182b78371d tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 204 len: 0 microversion: 2.1 time: 0.135052 Aug 26 12:26:27.314967 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 511/1023] 10.222.0.61 () {58 vars in 1239 bytes} [Fri Aug 26 12:26:27 2022] DELETE /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 26 12:26:27.323738 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:27.324393 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:27.334557 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:27.335540 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:27.336481 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:27.338262 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:27.338723 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:27.339363 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:27.483727 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:27.492948 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-09f6a46e-e7b8-430c-96d3-07fedbc3fc79 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1503 microversion: 2.1 time: 0.173414 Aug 26 12:26:27.494004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 513/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:27 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 26 12:26:28.515379 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:28.516964 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:28.528040 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:28.528933 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:28.529550 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:28.530595 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:28.531246 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:28.532627 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:28.734048 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:28.743848 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-30612f73-3ddf-4f92-8f81-ad62cd7170aa tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1503 microversion: 2.1 time: 0.233106 Aug 26 12:26:28.747236 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 512/1025] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:28 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:29.264230 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-c6008f50-ec15-4137-a766-daa69091e830 req-d4ddba40-3e26-437b-9157-9f6dafbfc120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1359e89d-5296-44b6-98c8-0c50b440c7f6", "name": "network-vif-deleted", "tag": "8e947449-fa91-4a98-a31c-48bf3496a9e1"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 26 12:26:29.290567 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6008f50-ec15-4137-a766-daa69091e830 req-d4ddba40-3e26-437b-9157-9f6dafbfc120 service nova] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:29.291073 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6008f50-ec15-4137-a766-daa69091e830 req-d4ddba40-3e26-437b-9157-9f6dafbfc120 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:29.291522 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c6008f50-ec15-4137-a766-daa69091e830 req-d4ddba40-3e26-437b-9157-9f6dafbfc120 service nova] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:29.307143 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c6008f50-ec15-4137-a766-daa69091e830 req-d4ddba40-3e26-437b-9157-9f6dafbfc120 service nova] Creating event network-vif-deleted:8e947449-fa91-4a98-a31c-48bf3496a9e1 for instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 on hv-cinder-84630 Aug 26 12:26:29.313837 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-c6008f50-ec15-4137-a766-daa69091e830 req-d4ddba40-3e26-437b-9157-9f6dafbfc120 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053280 Aug 26 12:26:29.314425 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 514/1026] 10.222.0.61 () {64 vars in 1317 bytes} [Fri Aug 26 12:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 26 12:26:29.765110 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:29.765754 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:29.768520 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:29.774082 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:29.774578 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:29.775016 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:29.775756 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:29.776211 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:29.776635 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:29.815036 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:29.815568 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:29.816066 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:29.816881 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lazy-loading 'fault' on Instance uuid 1359e89d-5296-44b6-98c8-0c50b440c7f6 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 26 12:26:29.862182 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07c76d1e62a4f4290b276bc233d953c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a6f1bf35060433bb91cdedf633ebcd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Aug 26 12:26:29.871358 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d05b947f-9b1c-4c54-bc48-dfe3dd41a99f tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 200 len: 1303 microversion: 2.1 time: 0.110111 Aug 26 12:26:29.872081 dv-cinder-846303-2-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 513/1027] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:29 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 26 12:26:30.893165 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 26 12:26:30.893863 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] [instance: 1359e89d-5296-44b6-98c8-0c50b440c7f6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 26 12:26:30.896302 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 12:26:30.902003 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:30.902518 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:30.902955 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:30.903828 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Acquiring lock "2e12ffa3-4320-4138-9a47-c092f122fe94" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 26 12:26:30.904286 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 26 12:26:30.904794 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Lock "2e12ffa3-4320-4138-9a47-c092f122fe94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 26 12:26:30.919223 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] HTTP exception thrown: Instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 could not be found. Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Request method failure captured: Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 HTTP/1.1 Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Connection: close Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Host: 10.222.0.61 Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.11 Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjCLvVA8hBC2tNDDGFt3fUIsC5Ym0LG1yQYJdkdKU5csCRuAgr-BcVZPFNanhX03PCu9Bskm0bOSt__5ZHg1kTYTcVkJ1KqbYsmn14uXhM1_B3K2jrfDMGfeCLf8c98uGzyg0tKVQdgKFbJlLWIQNRRtIyjTW7yaNRBBosKYU16LURM-M Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Id: 9a6f1bf35060433bb91cdedf633ebcd8 Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesActionsTest-236123186 Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Role: member,reader Aug 26 12:26:30.920824 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Roles: member,reader Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a6f1bf35060433bb91cdedf633ebcd8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a6f1bf35060433bb91cdedf633ebcd8", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a6f1bf35060433bb91cdedf633ebcd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a6f1bf35060433bb91cdedf633ebcd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}] Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesActionsTest-236123186 Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 9a6f1bf35060433bb91cdedf633ebcd8 Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesActionsTest-236123186 Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesActionsTest-236123186-project Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Id: b07c76d1e62a4f4290b276bc233d953c Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesActionsTest-236123186-project Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: method: > Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: exception: Instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 could not be found. Aug 26 12:26:30.922475 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: action_args: {'id': '1359e89d-5296-44b6-98c8-0c50b440c7f6'} Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 could not be found. Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 26 12:26:30.924004 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 could not be found. Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 could not be found. Aug 26 12:26:30.925523 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 26 12:26:30.926919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] Returning 404 to user: Instance 1359e89d-5296-44b6-98c8-0c50b440c7f6 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 26 12:26:30.926919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8868af96-ce4a-41af-b699-1e2295c1e871 tempest-VolumesActionsTest-236123186 tempest-VolumesActionsTest-236123186-project] 10.222.0.61 "GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6" status: 404 len: 111 microversion: 2.1 time: 0.033327 Aug 26 12:26:30.926919 dv-cinder-846303-2-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 515/1028] 10.222.0.61 () {58 vars in 1236 bytes} [Fri Aug 26 12:26:30 2022] GET /compute/v2.1/servers/1359e89d-5296-44b6-98c8-0c50b440c7f6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)